Nov 29 22:57:29 user nova-compute[75244]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75244) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75244) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75244) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 22:57:29 user nova-compute[75244]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:57:29 user nova-compute[75244]: INFO nova.virt.driver [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 22:57:29 user nova-compute[75244]: INFO nova.compute.provider_config [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Acquiring lock "singleton_lock" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Acquired lock "singleton_lock" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Releasing lock "singleton_lock" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Full set of CONF: {{(pid=75244) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ******************************************************************************** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Configuration options gathered from: {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ================================================================================ {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] allow_resize_to_same_host      = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] arq_binding_timeout            = 300 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] backdoor_port                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] backdoor_socket                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] block_device_allocate_retries  = 300 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] block_device_allocate_retries_interval = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cert                           = self.pem {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute_monitors               = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] config_dir                     = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] config_drive_format            = iso9660 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] config_source                  = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] console_host                   = user {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] control_exchange               = nova {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cpu_allocation_ratio           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] daemon                         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] debug                          = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] default_access_ip_network_name = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] default_availability_zone      = nova {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] default_ephemeral_format       = ext4 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] default_green_pool_size        = 1000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] default_schedule_zone          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] disk_allocation_ratio          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] enable_new_services            = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] enabled_apis                   = ['osapi_compute'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] enabled_ssl_apis               = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] flat_injected                  = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] force_config_drive             = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] force_raw_images               = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] graceful_shutdown_timeout      = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] heal_instance_info_cache_interval = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] host                           = user {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_build_timeout         = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_delete_interval       = 300 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_format                = [instance: %(uuid)s]  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_name_template         = instance-%08x {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_usage_audit           = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_usage_audit_period    = month {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] internal_service_availability_zone = internal {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] key                            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] live_migration_retry_count     = 30 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_config_append              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_dir                        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_file                       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_options                    = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_rotate_interval            = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_rotate_interval_type       = days {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] log_rotation_type              = none {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] long_rpc_timeout               = 1800 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] max_concurrent_builds          = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] max_concurrent_live_migrations = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] max_concurrent_snapshots       = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] max_local_block_devices        = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] max_logfile_count              = 30 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] max_logfile_size_mb            = 200 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] maximum_instance_delete_attempts = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metadata_listen                = 0.0.0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metadata_listen_port           = 8775 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metadata_workers               = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] migrate_max_retries            = -1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] mkisofs_cmd                    = genisoimage {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] my_ip                          = 10.0.0.210 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] network_allocate_retries       = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] osapi_compute_listen_port      = 8774 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] osapi_compute_unique_server_name_scope =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] osapi_compute_workers          = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] password_length                = 12 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] periodic_enable                = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] periodic_fuzzy_delay           = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] pointer_model                  = ps2mouse {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] preallocate_images             = none {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] publish_errors                 = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] pybasedir                      = /opt/stack/nova {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ram_allocation_ratio           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rate_limit_burst               = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rate_limit_except_level        = CRITICAL {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rate_limit_interval            = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reboot_timeout                 = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reclaim_instance_interval      = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] record                         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reimage_timeout_per_gb         = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] report_interval                = 120 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rescue_timeout                 = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reserved_host_cpus             = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reserved_host_disk_mb          = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reserved_host_memory_mb        = 512 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] reserved_huge_pages            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] resize_confirm_window          = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] resize_fs_using_block_device   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] resume_guests_state_on_host_boot = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rpc_response_timeout           = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] run_external_periodic_tasks    = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] running_deleted_instance_action = reap {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] running_deleted_instance_poll_interval = 1800 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] running_deleted_instance_timeout = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler_instance_sync_interval = 120 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_down_time              = 720 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] servicegroup_driver            = db {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] shelved_offload_time           = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] shelved_poll_interval          = 3600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] shutdown_timeout               = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] source_is_ipv6                 = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ssl_only                       = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] state_path                     = /opt/stack/data/nova {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] sync_power_state_interval      = 600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] sync_power_state_pool_size     = 1000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] syslog_log_facility            = LOG_USER {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] tempdir                        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] timeout_nbd                    = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] transport_url                  = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] update_resources_interval      = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_cow_images                 = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_eventlog                   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_journal                    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_json                       = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_rootwrap_daemon            = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_stderr                     = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] use_syslog                     = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vcpu_pin_set                   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plugging_is_fatal          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plugging_timeout           = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] virt_mkfs                      = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] volume_usage_poll_interval     = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] watch_log_file                 = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] web                            = /usr/share/spice-html5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_concurrency.disable_process_locking = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.auth_strategy              = keystone {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.compute_link_prefix        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.dhcp_domain                = novalocal {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.enable_instance_password   = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.glance_link_prefix         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.instance_list_per_project_cells = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.list_records_by_skipping_down_cells = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.local_metadata_per_cell    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.max_limit                  = 1000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.metadata_cache_expiration  = 15 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.neutron_default_tenant_id  = default {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.use_forwarded_for          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.use_neutron_default_nets   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_dynamic_targets = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_jsonfile_path   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.backend                  = dogpile.cache.memcached {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.backend_argument         = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.config_prefix            = cache.oslo {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.dead_timeout             = 60.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.debug_cache_backend      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.enable_retry_client      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.enable_socket_keepalive  = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.enabled                  = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.expiration_time          = 600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.hashclient_retry_attempts = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_dead_retry      = 300 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_password        =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_pool_maxsize    = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_sasl_enabled    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.memcache_username        =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.proxies                  = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.retry_attempts           = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.retry_delay              = 0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.socket_keepalive_count   = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.socket_keepalive_idle    = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.socket_keepalive_interval = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.tls_allowed_ciphers      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.tls_cafile               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.tls_certfile             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.tls_enabled              = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cache.tls_keyfile              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.auth_section            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.auth_type               = password {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.cafile                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.certfile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.collect_timing          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.cross_az_attach         = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.debug                   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.endpoint_template       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.http_retries            = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.insecure                = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.keyfile                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.os_region_name          = RegionOne {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.split_loggers           = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cinder.timeout                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.cpu_dedicated_set      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.cpu_shared_set         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.image_type_exclude_list = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.max_concurrent_disk_ops = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.max_disk_devices_to_attach = -1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.resource_provider_association_refresh = 300 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.shutdown_retry_interval = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] conductor.workers              = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] console.allowed_origins        = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] console.ssl_ciphers            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] console.ssl_minimum_version    = default {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] consoleauth.token_ttl          = 600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.cafile                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.certfile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.collect_timing          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.connect_retries         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.connect_retry_delay     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.endpoint_override       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.insecure                = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.keyfile                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.max_version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.min_version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.region_name             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.service_name            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.service_type            = accelerator {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.split_loggers           = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.status_code_retries     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.timeout                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] cyborg.version                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.backend               = sqlalchemy {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.connection            = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.connection_debug      = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.connection_parameters =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.connection_recycle_time = 3600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.connection_trace      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.db_inc_retry_interval = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.db_max_retries        = 20 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.db_max_retry_interval = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.db_retry_interval     = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.max_overflow          = 50 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.max_pool_size         = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.max_retries           = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.mysql_wsrep_sync_wait = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.pool_timeout          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.retry_interval        = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.slave_connection      = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] database.sqlite_synchronous    = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.backend           = sqlalchemy {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.connection        = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.connection_debug  = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.connection_parameters =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.connection_recycle_time = 3600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.connection_trace  = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.db_inc_retry_interval = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.db_max_retries    = 20 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.db_max_retry_interval = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.db_retry_interval = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.max_overflow      = 50 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.max_pool_size     = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.max_retries       = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.pool_timeout      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.retry_interval    = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.slave_connection  = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] api_database.sqlite_synchronous = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] devices.enabled_mdev_types     = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ephemeral_storage_encryption.enabled = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.api_servers             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.cafile                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.certfile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.collect_timing          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.connect_retries         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.connect_retry_delay     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.debug                   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.default_trusted_certificate_ids = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.enable_certificate_validation = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.enable_rbd_download     = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.endpoint_override       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.insecure                = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.keyfile                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.max_version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.min_version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.num_retries             = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.rbd_ceph_conf           =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.rbd_connect_timeout     = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.rbd_pool                =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.rbd_user                =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.region_name             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.service_name            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.service_type            = image {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.split_loggers           = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.status_code_retries     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.timeout                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.verify_glance_signatures = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] glance.version                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] guestfs.debug                  = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.config_drive_cdrom      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.config_drive_inject_password = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.enable_instance_metrics_collection = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.enable_remotefx         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.instances_path_share    =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.iscsi_initiator_list    = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.limit_cpu_features      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.power_state_check_timeframe = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.use_multipath_io        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.volume_attach_retry_count = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.vswitch_name            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] mks.enabled                    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] image_cache.manager_interval   = 2400 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] image_cache.precache_concurrency = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] image_cache.remove_unused_base_images = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] image_cache.subdirectory_name  = _base {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.api_max_retries         = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.api_retry_interval      = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.auth_section            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.auth_type               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.cafile                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.certfile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.collect_timing          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.conductor_group         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.connect_retries         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.connect_retry_delay     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.endpoint_override       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.insecure                = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.keyfile                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.max_version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.min_version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.peer_list               = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.region_name             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.serial_console_state_timeout = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.service_name            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.service_type            = baremetal {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.split_loggers           = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.status_code_retries     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.timeout                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ironic.version                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] key_manager.fixed_key          = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.barbican_api_version  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.barbican_endpoint     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.barbican_endpoint_type = public {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.barbican_region_name  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.cafile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.certfile              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.collect_timing        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.insecure              = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.keyfile               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.number_of_retries     = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.retry_delay           = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.send_service_user_token = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.split_loggers         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.timeout               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.verify_ssl            = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican.verify_ssl_path       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.auth_section = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.auth_type = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.cafile   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.certfile = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.collect_timing = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.insecure = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.keyfile  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.split_loggers = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] barbican_service_user.timeout  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.approle_role_id          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.approle_secret_id        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.cafile                   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.certfile                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.collect_timing           = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.insecure                 = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.keyfile                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.kv_mountpoint            = secret {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.kv_path                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.kv_version               = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.namespace                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.root_token_id            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.split_loggers            = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.ssl_ca_crt_file          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.timeout                  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.use_ssl                  = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.auth_section          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.auth_type             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.cafile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.certfile              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.collect_timing        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.connect_retries       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.connect_retry_delay   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.endpoint_override     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.insecure              = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.keyfile               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.max_version           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.min_version           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.region_name           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.service_name          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.service_type          = identity {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.split_loggers         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.status_code_retries   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.timeout               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] keystone.version               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.connection_uri         =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_mode               = custom {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: WARNING oslo_config.cfg [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_power_governor_high = performance {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_power_governor_low = powersave {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_power_management   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.device_detach_attempts = 8 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.device_detach_timeout  = 20 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.disk_cachemodes        = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.disk_prefix            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.enabled_perf_events    = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.file_backed_memory     = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.gid_maps               = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.hw_disk_discard        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.hw_machine_type        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_rbd_glance_store_name =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_rbd_pool        = rbd {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_type            = default {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.images_volume_group    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.inject_key             = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.inject_partition       = -2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.inject_password        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.iscsi_iface            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.iser_use_multipath     = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_bandwidth = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_downtime = 500 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_inbound_addr = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_permit_post_copy = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_scheme  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_timeout_action = abort {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_tunnelled = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: WARNING oslo_config.cfg [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 22:57:29 user nova-compute[75244]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 22:57:29 user nova-compute[75244]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 22:57:29 user nova-compute[75244]: and ``live_migration_inbound_addr`` respectively.
Nov 29 22:57:29 user nova-compute[75244]: ).  Its value may be silently ignored in the future.
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.live_migration_with_native_tls = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.max_queues             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.nfs_mount_options      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.num_memory_encrypted_guests = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.num_pcie_ports         = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.pmem_namespaces        = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.quobyte_client_cfg     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rbd_secret_uuid        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rbd_user               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.remote_filesystem_transport = ssh {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rescue_image_id        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rescue_kernel_id       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rescue_ramdisk_id      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.rx_queue_size          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.smbfs_mount_options    =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.snapshot_compression   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.snapshot_image_format  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.sparse_logical_volumes = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.swtpm_enabled          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.swtpm_group            = tss {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.swtpm_user             = tss {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.sysinfo_serial         = unique {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.tb_cache_size          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.tx_queue_size          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.uid_maps               = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.use_virtio_for_bridges = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.virt_type              = kvm {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.volume_clear           = zero {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.volume_clear_size      = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.volume_use_multipath   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_cache_path   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.vzstorage_mount_user   = stack {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.auth_section           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.auth_type              = password {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.cafile                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.certfile               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.collect_timing         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.connect_retries        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.connect_retry_delay    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.default_floating_pool  = public {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.endpoint_override      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.extension_sync_interval = 600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.http_retries           = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.insecure               = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.keyfile                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.max_version            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.min_version            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.ovs_bridge             = br-int {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.physnets               = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.region_name            = RegionOne {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.service_metadata_proxy = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.service_name           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.service_type           = network {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.split_loggers          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.status_code_retries    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.timeout                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] neutron.version                = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] notifications.bdms_in_notifications = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] notifications.default_level    = INFO {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] notifications.notification_format = unversioned {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] notifications.notify_on_state_change = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] pci.alias                      = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] pci.device_spec                = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] pci.report_in_placement        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.auth_section         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.auth_type            = password {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.cafile               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.certfile             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.collect_timing       = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.connect_retries      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.connect_retry_delay  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.default_domain_id    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.default_domain_name  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.domain_id            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.domain_name          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.endpoint_override    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.insecure             = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.keyfile              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.max_version          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.min_version          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.password             = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.project_domain_id    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.project_domain_name  = Default {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.project_id           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.project_name         = service {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.region_name          = RegionOne {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.service_name         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.service_type         = placement {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.split_loggers        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.status_code_retries  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.system_scope         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.timeout              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.trust_id             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.user_domain_id       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.user_domain_name     = Default {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.user_id              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.username             = placement {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] placement.version              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.cores                    = 20 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.count_usage_from_placement = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.injected_file_content_bytes = 10240 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.injected_file_path_length = 255 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.injected_files           = 5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.instances                = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.key_pairs                = 100 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.metadata_items           = 128 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.ram                      = 51200 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.recheck_quota            = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.server_group_members     = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] quota.server_groups            = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rdp.enabled                    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.image_metadata_prefilter = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.max_attempts         = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.max_placement_results = 1000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.query_placement_for_image_type_support = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] scheduler.workers              = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.host_subset_size = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.isolated_hosts = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.isolated_images = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.pci_in_placement = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.track_instance_changes = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metrics.required               = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metrics.weight_multiplier      = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] metrics.weight_setting         = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] serial_console.enabled         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] serial_console.port_range      = 10000:20000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] serial_console.serialproxy_port = 6083 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.auth_section      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.auth_type         = password {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.cafile            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.certfile          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.collect_timing    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.insecure          = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.keyfile           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.send_service_user_token = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.split_loggers     = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] service_user.timeout           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.agent_enabled            = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.enabled                  = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.html5proxy_port          = 6082 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.image_compression        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.jpeg_compression         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.playback_compression     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.server_listen            = 127.0.0.1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.streaming_mode           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] spice.zlib_compression         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] upgrade_levels.baseapi         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] upgrade_levels.compute         = auto {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] upgrade_levels.conductor       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] upgrade_levels.scheduler       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.auth_section = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.auth_type = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.cafile = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.certfile = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.insecure = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.keyfile = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vendordata_dynamic_auth.timeout = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.api_retry_count         = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.ca_file                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.cache_prefix            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.cluster_name            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.connection_pool_size    = 10 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.console_delay_seconds   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.datastore_regex         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.host_ip                 = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.host_password           = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.host_port               = 443 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.host_username           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.insecure                = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.integration_bridge      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.maximum_objects         = 100 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.pbm_default_policy      = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.pbm_enabled             = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.pbm_wsdl_location       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.serial_port_proxy_uri   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.serial_port_service_uri = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.task_poll_interval      = 0.5 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.use_linked_clone        = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.vnc_keymap              = en-us {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.vnc_port                = 5900 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vmware.vnc_port_total          = 10000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.auth_schemes               = ['none'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.enabled                    = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.novncproxy_port            = 6080 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.server_listen              = 0.0.0.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.vencrypt_ca_certs          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.vencrypt_client_cert       = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vnc.vencrypt_client_key        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.disable_rootwrap   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.enable_numa_live_migration = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.libvirt_disable_apic = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.client_socket_timeout     = 900 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.default_pool_size         = 1000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.keep_alive                = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.max_header_line           = 16384 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.ssl_ca_file               = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.ssl_cert_file             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.ssl_key_file              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.tcp_keepidle              = 600 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] zvm.ca_file                    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] zvm.cloud_connector_url        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] zvm.reachable_timeout          = 300 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.enforce_new_defaults = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.enforce_scope      = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.policy_default_rule = default {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.policy_file        = policy.yaml {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.connection_string     = messaging:// {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.enabled               = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.es_doc_type           = notification {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.es_scroll_size        = 10000 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.es_scroll_time        = 2m {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.filter_error_trace    = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.hmac_keys             = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.sentinel_service_name = mymaster {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.socket_timeout        = 0.1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.trace_requests        = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler.trace_sqlalchemy      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler_jaeger.process_tags   = {} {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler_jaeger.service_name_prefix = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] profiler_otlp.service_name_prefix = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] remote_debug.host              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] remote_debug.port              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.ssl      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_notifications.retry = -1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.auth_section        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.auth_type           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.cafile              = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.certfile            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.collect_timing      = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.connect_retries     = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.connect_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.endpoint_id         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.endpoint_override   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.insecure            = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.keyfile             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.max_version         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.min_version         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.region_name         = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.service_name        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.service_type        = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.split_loggers       = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.status_code_retries = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.status_code_retry_delay = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.timeout             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.valid_interfaces    = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_limit.version             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_reports.file_event_handler = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] oslo_reports.log_dir           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_ovs_privileged.group  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] vif_plug_ovs_privileged.user   = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.flat_interface = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.isolate_vif         = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_vif_ovs.per_port_bridge     = False {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] os_brick.lock_path             = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] privsep_osbrick.capabilities   = [21] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] privsep_osbrick.group          = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] privsep_osbrick.helper_command = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] privsep_osbrick.user           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] nova_sys_admin.group           = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] nova_sys_admin.helper_command  = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] nova_sys_admin.user            = None {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG oslo_service.service [None req-cb1afa76-21f8-4372-ab2e-f753d3d8cd4e None None] ******************************************************************************** {{(pid=75244) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 22:57:29 user nova-compute[75244]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 22:57:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Connecting to libvirt: qemu:///system {{(pid=75244) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 22:57:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa80d8163b0> {{(pid=75244) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 22:57:29 user nova-compute[75244]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 22:57:29 user nova-compute[75244]: WARNING nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 22:57:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa80d8163b0> {{(pid=75244) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 22:57:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Starting native event thread {{(pid=75244) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 22:57:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Starting green dispatch thread {{(pid=75244) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 22:57:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Starting connection event dispatch thread {{(pid=75244) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 22:57:30 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Connection event '1' reason 'None'
Nov 29 22:57:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 22:57:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.mount [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Initialising _HostMountState generation 0 {{(pid=75244) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 22:57:37 user nova-compute[75244]: INFO nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host capabilities <capabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <host>
Nov 29 22:57:37 user nova-compute[75244]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 22:57:37 user nova-compute[75244]:     <cpu>
Nov 29 22:57:37 user nova-compute[75244]:       <arch>x86_64</arch>
Nov 29 22:57:37 user nova-compute[75244]:       <model>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <microcode version='1070'/>
Nov 29 22:57:37 user nova-compute[75244]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='osxsave'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='invtsc'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='rsba'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 22:57:37 user nova-compute[75244]:       <pages unit='KiB' size='4'/>
Nov 29 22:57:37 user nova-compute[75244]:       <pages unit='KiB' size='2048'/>
Nov 29 22:57:37 user nova-compute[75244]:     </cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <power_management>
Nov 29 22:57:37 user nova-compute[75244]:       <suspend_mem/>
Nov 29 22:57:37 user nova-compute[75244]:       <suspend_disk/>
Nov 29 22:57:37 user nova-compute[75244]:       <suspend_hybrid/>
Nov 29 22:57:37 user nova-compute[75244]:     </power_management>
Nov 29 22:57:37 user nova-compute[75244]:     <iommu support='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <migration_features>
Nov 29 22:57:37 user nova-compute[75244]:       <live/>
Nov 29 22:57:37 user nova-compute[75244]:       <uri_transports>
Nov 29 22:57:37 user nova-compute[75244]:         <uri_transport>tcp</uri_transport>
Nov 29 22:57:37 user nova-compute[75244]:         <uri_transport>rdma</uri_transport>
Nov 29 22:57:37 user nova-compute[75244]:       </uri_transports>
Nov 29 22:57:37 user nova-compute[75244]:     </migration_features>
Nov 29 22:57:37 user nova-compute[75244]:     <topology>
Nov 29 22:57:37 user nova-compute[75244]:       <cells num='2'>
Nov 29 22:57:37 user nova-compute[75244]:         <cell id='0'>
Nov 29 22:57:37 user nova-compute[75244]:           <memory unit='KiB'>8189224</memory>
Nov 29 22:57:37 user nova-compute[75244]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 29 22:57:37 user nova-compute[75244]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 22:57:37 user nova-compute[75244]:           <distances>
Nov 29 22:57:37 user nova-compute[75244]:             <sibling id='0' value='10'/>
Nov 29 22:57:37 user nova-compute[75244]:             <sibling id='1' value='20'/>
Nov 29 22:57:37 user nova-compute[75244]:           </distances>
Nov 29 22:57:37 user nova-compute[75244]:           <cpus num='6'>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 22:57:37 user nova-compute[75244]:           </cpus>
Nov 29 22:57:37 user nova-compute[75244]:         </cell>
Nov 29 22:57:37 user nova-compute[75244]:         <cell id='1'>
Nov 29 22:57:37 user nova-compute[75244]:           <memory unit='KiB'>8206488</memory>
Nov 29 22:57:37 user nova-compute[75244]:           <pages unit='KiB' size='4'>2051622</pages>
Nov 29 22:57:37 user nova-compute[75244]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 22:57:37 user nova-compute[75244]:           <distances>
Nov 29 22:57:37 user nova-compute[75244]:             <sibling id='0' value='20'/>
Nov 29 22:57:37 user nova-compute[75244]:             <sibling id='1' value='10'/>
Nov 29 22:57:37 user nova-compute[75244]:           </distances>
Nov 29 22:57:37 user nova-compute[75244]:           <cpus num='6'>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 22:57:37 user nova-compute[75244]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 22:57:37 user nova-compute[75244]:           </cpus>
Nov 29 22:57:37 user nova-compute[75244]:         </cell>
Nov 29 22:57:37 user nova-compute[75244]:       </cells>
Nov 29 22:57:37 user nova-compute[75244]:     </topology>
Nov 29 22:57:37 user nova-compute[75244]:     <cache>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 22:57:37 user nova-compute[75244]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 22:57:37 user nova-compute[75244]:     </cache>
Nov 29 22:57:37 user nova-compute[75244]:     <secmodel>
Nov 29 22:57:37 user nova-compute[75244]:       <model>apparmor</model>
Nov 29 22:57:37 user nova-compute[75244]:       <doi>0</doi>
Nov 29 22:57:37 user nova-compute[75244]:     </secmodel>
Nov 29 22:57:37 user nova-compute[75244]:     <secmodel>
Nov 29 22:57:37 user nova-compute[75244]:       <model>dac</model>
Nov 29 22:57:37 user nova-compute[75244]:       <doi>0</doi>
Nov 29 22:57:37 user nova-compute[75244]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 22:57:37 user nova-compute[75244]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 22:57:37 user nova-compute[75244]:     </secmodel>
Nov 29 22:57:37 user nova-compute[75244]:   </host>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='alpha'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>clipper</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='armv6l'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>spitz</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>nuri</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>kzm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sx1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>z2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>tosa</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>n810</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>n800</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>terrier</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>midway</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>microbit</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>verdex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>highbank</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>akita</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>connex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>collie</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='armv7l'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>spitz</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>nuri</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>kzm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sx1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>z2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>tosa</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>n810</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>n800</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>terrier</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>midway</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>microbit</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>verdex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>highbank</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>akita</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>connex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>collie</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='aarch64'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>spitz</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>nuri</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>kzm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sx1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>z2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>tosa</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>n810</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>n800</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>terrier</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>midway</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>microbit</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>verdex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>highbank</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>akita</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>connex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>collie</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <acpi default='on' toggle='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='cris'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='i686'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>isapc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>microvm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='kvm'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <pae/>
Nov 29 22:57:37 user nova-compute[75244]:       <nonpae/>
Nov 29 22:57:37 user nova-compute[75244]:       <acpi default='on' toggle='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:       <apic default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='m68k'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>an5206</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>q800</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='microblaze'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='microblazeel'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='mips'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='16'>malta</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='mipsel'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='16'>malta</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='mips64'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='16'>malta</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>pica61</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>magnum</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='mips64el'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='16'>malta</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>pica61</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>magnum</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='16'>boston</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='ppc'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mac99</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>40p</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>taihu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='ppc64'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>taihu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>40p</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mac99</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='ppc64le'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>taihu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>40p</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>mac99</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='riscv32'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='8'>spike</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='8'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='riscv64'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='8'>spike</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='8'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='s390x'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='sh4'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>shix</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>r2d</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='sh4eb'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>shix</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>r2d</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='sparc'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>LX</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='sparc64'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>niagara</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='x86_64'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>64</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='1'>isapc</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>microvm</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='kvm'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <acpi default='on' toggle='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:       <apic default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='xtensa'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>sim</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>kc705</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ml605</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx200</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx60</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]:   <guest>
Nov 29 22:57:37 user nova-compute[75244]:     <os_type>hvm</os_type>
Nov 29 22:57:37 user nova-compute[75244]:     <arch name='xtensaeb'>
Nov 29 22:57:37 user nova-compute[75244]:       <wordsize>32</wordsize>
Nov 29 22:57:37 user nova-compute[75244]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='4'>sim</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>kc705</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ml605</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>virt</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx200</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>lx60</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 22:57:37 user nova-compute[75244]:       <domain type='qemu'/>
Nov 29 22:57:37 user nova-compute[75244]:     </arch>
Nov 29 22:57:37 user nova-compute[75244]:     <features>
Nov 29 22:57:37 user nova-compute[75244]:       <cpuselection/>
Nov 29 22:57:37 user nova-compute[75244]:       <deviceboot/>
Nov 29 22:57:37 user nova-compute[75244]:       <disksnapshot default='on' toggle='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     </features>
Nov 29 22:57:37 user nova-compute[75244]:   </guest>
Nov 29 22:57:37 user nova-compute[75244]: </capabilities>
Nov 29 22:57:37 user nova-compute[75244]: 
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-i440fx-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>i686</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='255'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'/>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='lm'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ide</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-q35-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>i686</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='288'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'/>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='lm'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-q35-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>i686</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='288'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'/>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='lm'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-i440fx-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>i686</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='255'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'/>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='lm'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ide</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-i440fx-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>x86_64</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='255'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>efi</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='invtsc'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='rsba'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ide</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-q35-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>x86_64</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='288'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>efi</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='invtsc'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='rsba'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-q35-6.2</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>x86_64</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='288'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>efi</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='invtsc'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='rsba'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 22:57:37 user nova-compute[75244]: <domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 22:57:37 user nova-compute[75244]:   <domain>kvm</domain>
Nov 29 22:57:37 user nova-compute[75244]:   <machine>pc-i440fx-jammy</machine>
Nov 29 22:57:37 user nova-compute[75244]:   <arch>x86_64</arch>
Nov 29 22:57:37 user nova-compute[75244]:   <vcpu max='255'/>
Nov 29 22:57:37 user nova-compute[75244]:   <iothreads supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:   <os supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='firmware'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>efi</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:     <loader supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>rom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pflash</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='readonly'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>yes</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='secure'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>no</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </loader>
Nov 29 22:57:37 user nova-compute[75244]:   </os>
Nov 29 22:57:37 user nova-compute[75244]:   <cpu>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-passthrough' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='hostPassthroughMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='maximum' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='maximumMigratable'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>on</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>off</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='host-model' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <vendor>Intel</vendor>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ss'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='vmx'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pcid'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='hypervisor'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arat'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='umip'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='md-clear'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='invtsc'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibpb'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='ibrs'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-stibp'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='rsba'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='erms'/>
Nov 29 22:57:37 user nova-compute[75244]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:     <mode name='custom' supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>qemu64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>qemu32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>phenom</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>pentium</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>n270</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm64</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>kvm32</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>coreduo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>core2duo</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>athlon</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Westmere</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Snowridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Skylake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>SandyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Penryn</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G5</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G4</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G3</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Opteron_G2</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Opteron_G1</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>IvyBridge</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Icelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Haswell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Rome</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-Milan</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>EPYC</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Dhyana</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cooperlake</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>Conroe</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='no'>Broadwell</model>
Nov 29 22:57:37 user nova-compute[75244]:       <model usable='yes'>486</model>
Nov 29 22:57:37 user nova-compute[75244]:     </mode>
Nov 29 22:57:37 user nova-compute[75244]:   </cpu>
Nov 29 22:57:37 user nova-compute[75244]:   <memoryBacking supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:     <enum name='sourceType'>
Nov 29 22:57:37 user nova-compute[75244]:       <value>file</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>anonymous</value>
Nov 29 22:57:37 user nova-compute[75244]:       <value>memfd</value>
Nov 29 22:57:37 user nova-compute[75244]:     </enum>
Nov 29 22:57:37 user nova-compute[75244]:   </memoryBacking>
Nov 29 22:57:37 user nova-compute[75244]:   <devices>
Nov 29 22:57:37 user nova-compute[75244]:     <disk supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='diskDevice'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>disk</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cdrom</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>floppy</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>lun</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='bus'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ide</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>fdc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sata</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </disk>
Nov 29 22:57:37 user nova-compute[75244]:     <graphics supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='type'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>sdl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vnc</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>spice</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egl-headless</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </graphics>
Nov 29 22:57:37 user nova-compute[75244]:     <video supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='modelType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>cirrus</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>vmvga</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>qxl</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>none</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>bochs</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>ramfb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </video>
Nov 29 22:57:37 user nova-compute[75244]:     <hostdev supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='mode'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>subsystem</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='startupPolicy'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>default</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>mandatory</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>requisite</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>optional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='subsysType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>usb</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>pci</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>scsi</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='capsType'/>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='pciBackend'/>
Nov 29 22:57:37 user nova-compute[75244]:     </hostdev>
Nov 29 22:57:37 user nova-compute[75244]:     <rng supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtio-non-transitional</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>random</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>egd</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>builtin</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </rng>
Nov 29 22:57:37 user nova-compute[75244]:     <filesystem supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='driverType'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>path</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>handle</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>virtiofs</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </filesystem>
Nov 29 22:57:37 user nova-compute[75244]:     <tpm supported='yes'>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='model'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-tis</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>tpm-crb</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:       <enum name='backendModel'>
Nov 29 22:57:37 user nova-compute[75244]:         <value>passthrough</value>
Nov 29 22:57:37 user nova-compute[75244]:         <value>emulator</value>
Nov 29 22:57:37 user nova-compute[75244]:       </enum>
Nov 29 22:57:37 user nova-compute[75244]:     </tpm>
Nov 29 22:57:37 user nova-compute[75244]:   </devices>
Nov 29 22:57:37 user nova-compute[75244]:   <features>
Nov 29 22:57:37 user nova-compute[75244]:     <gic supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:     <vmcoreinfo supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <genid supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backingStoreInput supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <backup supported='yes'/>
Nov 29 22:57:37 user nova-compute[75244]:     <sev supported='no'/>
Nov 29 22:57:37 user nova-compute[75244]:   </features>
Nov 29 22:57:37 user nova-compute[75244]: </domainCapabilities>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75244) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75244) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Checking secure boot support for host arch (x86_64) {{(pid=75244) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Checking secure boot support for host arch (x86_64) {{(pid=75244) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Checking secure boot support for host arch (x86_64) {{(pid=75244) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 22:57:37 user nova-compute[75244]: INFO nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Secure Boot support detected
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] cpu compare xml: <cpu match="exact">
Nov 29 22:57:37 user nova-compute[75244]:   <model>Nehalem</model>
Nov 29 22:57:37 user nova-compute[75244]: </cpu>
Nov 29 22:57:37 user nova-compute[75244]:  {{(pid=75244) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 22:57:37 user nova-compute[75244]: INFO nova.virt.node [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Generated node identity cc9d5100-ee82-415a-9911-9d1a045bcd6b
Nov 29 22:57:37 user nova-compute[75244]: INFO nova.virt.node [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Wrote node identity cc9d5100-ee82-415a-9911-9d1a045bcd6b to /opt/stack/data/nova/compute_id
Nov 29 22:57:37 user nova-compute[75244]: WARNING nova.compute.manager [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Compute nodes ['cc9d5100-ee82-415a-9911-9d1a045bcd6b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 22:57:37 user nova-compute[75244]: INFO nova.compute.manager [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 22:57:37 user nova-compute[75244]: WARNING nova.compute.manager [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 22:57:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:57:37 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:57:37 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:57:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Hypervisor/Node resource view: name=user free_ram=10979MB free_disk=26.116111755371094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:57:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:57:37 user nova-compute[75244]: WARNING nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] No compute node record for user:cc9d5100-ee82-415a-9911-9d1a045bcd6b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cc9d5100-ee82-415a-9911-9d1a045bcd6b could not be found.
Nov 29 22:57:38 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Compute node record created for user:user with uuid: cc9d5100-ee82-415a-9911-9d1a045bcd6b
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:57:38 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] [req-f58d18ef-5d94-419a-9731-1bd7aaee511b] Created resource provider record via placement API for resource provider with UUID cc9d5100-ee82-415a-9911-9d1a045bcd6b and name user.
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75244) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 22:57:38 user nova-compute[75244]: INFO nova.virt.libvirt.host [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] kernel doesn't support AMD SEV
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Libvirt baseline CPU <cpu>
Nov 29 22:57:38 user nova-compute[75244]:   <arch>x86_64</arch>
Nov 29 22:57:38 user nova-compute[75244]:   <model>Nehalem</model>
Nov 29 22:57:38 user nova-compute[75244]:   <vendor>Intel</vendor>
Nov 29 22:57:38 user nova-compute[75244]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 22:57:38 user nova-compute[75244]: </cpu>
Nov 29 22:57:38 user nova-compute[75244]:  {{(pid=75244) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Updated inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Updating resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b generation from 0 to 1 during operation: update_inventory {{(pid=75244) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Updating resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b generation from 1 to 2 during operation: update_traits {{(pid=75244) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.service [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Creating RPC server for service compute {{(pid=75244) start /opt/stack/nova/nova/service.py:182}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.service [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] Join ServiceGroup membership for this service compute {{(pid=75244) start /opt/stack/nova/nova/service.py:199}}
Nov 29 22:57:38 user nova-compute[75244]: DEBUG nova.servicegroup.drivers.db [None req-2347131c-9cb4-418c-b248-dd5dc1327bb8 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75244) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 22:58:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:58:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:58:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=10363MB free_disk=26.019832611083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:58:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:59:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:59:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:59:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:59:30 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=26.072940826416016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:59:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:00:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:00:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=10334MB free_disk=25.836517333984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:00:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:00:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:00:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:01:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9625MB free_disk=25.856624603271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:01:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:01:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:01:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:01:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:01:32 user nova-compute[75244]: INFO nova.compute.claims [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Claim successful on node user
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:01:32 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:01:32 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Creating image(s)
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "/opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "/opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "/opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:33 user nova-compute[75244]: DEBUG nova.policy [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48e5bb05edc6476fb506bd68034d83d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b30da76f04446f699625b28e337ed09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:01:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:01:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG nova.virt.images [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] bb216299-2134-4398-939c-137bca845056 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.part /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.part /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.converted" returned: 0 in 0.165s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.652s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:34 user nova-compute[75244]: INFO oslo.privsep.daemon [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpindj3uil/privsep.sock']
Nov 29 23:01:34 user sudo[84499]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpindj3uil/privsep.sock
Nov 29 23:01:34 user sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 23:01:34 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Successfully created port: 470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:01:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:01:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:35 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:01:35 user nova-compute[75244]: INFO nova.compute.claims [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Claim successful on node user
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:01:36 user sudo[84499]: pam_unix(sudo:session): session closed for user root
Nov 29 23:01:36 user nova-compute[75244]: INFO oslo.privsep.daemon [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Spawned new privsep daemon via rootwrap
Nov 29 23:01:36 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 23:01:36 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 23:01:36 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 23:01:36 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84510
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:01:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.policy [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f680496b0c147a48948cb1f24c65797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15889b42830c48049aa8537bd8e82d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:01:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Creating image(s)
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "/opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "/opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk 1073741824" returned: 0 in 0.046s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.238s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.213s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk 1073741824" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Cannot resize image /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Ensure instance console log exists: /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Cannot resize image /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Ensure instance console log exists: /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Successfully updated port: 470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquired lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:01:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Successfully created port: 856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:01:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-changed-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Refreshing instance network info cache due to event network-changed-470fec0d-9ed4-4231-83d8-e99d177bc04c. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] Acquiring lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updating instance_info_cache with network_info: [{"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Releasing lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Instance network_info: |[{"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] Acquired lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.network.neutron [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Refreshing network info cache for port 470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Start _get_guest_xml network_info=[{"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:01:39 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:39 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1640220047',display_name='tempest-DeleteServersTestJSON-server-1640220047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1640220047',id=1,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b30da76f04446f699625b28e337ed09',ramdisk_id='',reservation_id='r-3kahwhts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-972125243',owner_user_name='tempest-DeleteServersTestJSON-972125243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:33Z,user_data=None,user_id='48e5bb05edc6476fb506bd68034d83d8',uuid=794fea73-9d39-499d-8904-7c916a669709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Converting VIF {"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lazy-loading 'pci_devices' on Instance uuid 794fea73-9d39-499d-8904-7c916a669709 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:01:39 user nova-compute[75244]:   <uuid>794fea73-9d39-499d-8904-7c916a669709</uuid>
Nov 29 23:01:39 user nova-compute[75244]:   <name>instance-00000001</name>
Nov 29 23:01:39 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:01:39 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:01:39 user nova-compute[75244]:   <metadata>
Nov 29 23:01:39 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:01:39 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:01:39 user nova-compute[75244]:       <nova:name>tempest-DeleteServersTestJSON-server-1640220047</nova:name>
Nov 29 23:01:39 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:01:39</nova:creationTime>
Nov 29 23:01:39 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:01:39 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:01:39 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:01:39 user nova-compute[75244]:       <nova:owner>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:user uuid="48e5bb05edc6476fb506bd68034d83d8">tempest-DeleteServersTestJSON-972125243-project-member</nova:user>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:project uuid="3b30da76f04446f699625b28e337ed09">tempest-DeleteServersTestJSON-972125243</nova:project>
Nov 29 23:01:39 user nova-compute[75244]:       </nova:owner>
Nov 29 23:01:39 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:01:39 user nova-compute[75244]:       <nova:ports>
Nov 29 23:01:39 user nova-compute[75244]:         <nova:port uuid="470fec0d-9ed4-4231-83d8-e99d177bc04c">
Nov 29 23:01:39 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 23:01:39 user nova-compute[75244]:         </nova:port>
Nov 29 23:01:39 user nova-compute[75244]:       </nova:ports>
Nov 29 23:01:39 user nova-compute[75244]:     </nova:instance>
Nov 29 23:01:39 user nova-compute[75244]:   </metadata>
Nov 29 23:01:39 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:01:39 user nova-compute[75244]:     <system>
Nov 29 23:01:39 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:01:39 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:01:39 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:01:39 user nova-compute[75244]:       <entry name="serial">794fea73-9d39-499d-8904-7c916a669709</entry>
Nov 29 23:01:39 user nova-compute[75244]:       <entry name="uuid">794fea73-9d39-499d-8904-7c916a669709</entry>
Nov 29 23:01:39 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:01:39 user nova-compute[75244]:     </system>
Nov 29 23:01:39 user nova-compute[75244]:   </sysinfo>
Nov 29 23:01:39 user nova-compute[75244]:   <os>
Nov 29 23:01:39 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:01:39 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:01:39 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:01:39 user nova-compute[75244]:   </os>
Nov 29 23:01:39 user nova-compute[75244]:   <features>
Nov 29 23:01:39 user nova-compute[75244]:     <acpi/>
Nov 29 23:01:39 user nova-compute[75244]:     <apic/>
Nov 29 23:01:39 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:01:39 user nova-compute[75244]:   </features>
Nov 29 23:01:39 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:01:39 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:01:39 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:01:39 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:01:39 user nova-compute[75244]:   </clock>
Nov 29 23:01:39 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:01:39 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:01:39 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:01:39 user nova-compute[75244]:   </cpu>
Nov 29 23:01:39 user nova-compute[75244]:   <devices>
Nov 29 23:01:39 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:01:39 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:01:39 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk"/>
Nov 29 23:01:39 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:01:39 user nova-compute[75244]:     </disk>
Nov 29 23:01:39 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:01:39 user nova-compute[75244]:       <mac address="fa:16:3e:49:f2:a1"/>
Nov 29 23:01:39 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:39 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:01:39 user nova-compute[75244]:       <target dev="tap470fec0d-9e"/>
Nov 29 23:01:39 user nova-compute[75244]:     </interface>
Nov 29 23:01:39 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:01:39 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/console.log" append="off"/>
Nov 29 23:01:39 user nova-compute[75244]:     </serial>
Nov 29 23:01:39 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:01:39 user nova-compute[75244]:     <video>
Nov 29 23:01:39 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:39 user nova-compute[75244]:     </video>
Nov 29 23:01:39 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:01:39 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:01:39 user nova-compute[75244]:     </rng>
Nov 29 23:01:39 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:01:39 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:01:39 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:01:39 user nova-compute[75244]:     </memballoon>
Nov 29 23:01:39 user nova-compute[75244]:   </devices>
Nov 29 23:01:39 user nova-compute[75244]: </domain>
Nov 29 23:01:39 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1640220047',display_name='tempest-DeleteServersTestJSON-server-1640220047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1640220047',id=1,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b30da76f04446f699625b28e337ed09',ramdisk_id='',reservation_id='r-3kahwhts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-972125243',owner_user_name='tempest-DeleteServersTestJSON-972125243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:33Z,user_data=None,user_id='48e5bb05edc6476fb506bd68034d83d8',uuid=794fea73-9d39-499d-8904-7c916a669709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Converting VIF {"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG os_vif [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Created schema index Interface.name {{(pid=75244) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Created schema index Port.name {{(pid=75244) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Created schema index Bridge.name {{(pid=75244) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [POLLOUT] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4b6b98b-5f0c-5785-a3d9-22ae356fabc6', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:39 user nova-compute[75244]: INFO oslo.privsep.daemon [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_8lkntq5/privsep.sock']
Nov 29 23:01:39 user sudo[84546]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_8lkntq5/privsep.sock
Nov 29 23:01:39 user sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 23:01:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:40 user nova-compute[75244]: DEBUG nova.network.neutron [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Successfully updated port: 856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:01:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquired lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:40 user nova-compute[75244]: DEBUG nova.network.neutron [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:01:40 user nova-compute[75244]: DEBUG nova.network.neutron [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-changed-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Refreshing instance network info cache due to event network-changed-856339eb-f4d3-4fce-abe7-bb017fcccbf7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] Acquiring lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:41 user sudo[84546]: pam_unix(sudo:session): session closed for user root
Nov 29 23:01:41 user nova-compute[75244]: INFO oslo.privsep.daemon [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Spawned new privsep daemon via rootwrap
Nov 29 23:01:41 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 23:01:41 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 23:01:41 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 23:01:41 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84549
Nov 29 23:01:41 user nova-compute[75244]: DEBUG nova.network.neutron [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updated VIF entry in instance network info cache for port 470fec0d-9ed4-4231-83d8-e99d177bc04c. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG nova.network.neutron [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updating instance_info_cache with network_info: [{"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-67331555-5d00-4cf4-a7dd-d31fc9a1b365 req-fceaaafb-411e-481b-90d2-c0754725c375 service nova] Releasing lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap470fec0d-9e, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap470fec0d-9e, col_values=(('qos', UUID('17eb70ad-ad70-4cb6-9b13-1d181d66669c')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap470fec0d-9e, col_values=(('external_ids', {'iface-id': '470fec0d-9ed4-4231-83d8-e99d177bc04c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:f2:a1', 'vm-uuid': '794fea73-9d39-499d-8904-7c916a669709'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:41 user nova-compute[75244]: INFO os_vif [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e')
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] No VIF found with MAC fa:16:3e:49:f2:a1, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updating instance_info_cache with network_info: [{"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Releasing lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Instance network_info: |[{"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] Acquired lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Refreshing network info cache for port 856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Start _get_guest_xml network_info=[{"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:01:42 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:42 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2095721698',display_name='tempest-ServersNegativeTestJSON-server-2095721698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2095721698',id=2,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15889b42830c48049aa8537bd8e82d56',ramdisk_id='',reservation_id='r-0f0cv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1248877561',owner_user_name='tempest-ServersNegativeTestJSON-1248877561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:36Z,user_data=None,user_id='7f680496b0c147a48948cb1f24c65797',uuid=0e2feb16-677d-4713-8646-dbed4fe33e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converting VIF {"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e2feb16-677d-4713-8646-dbed4fe33e59 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:01:42 user nova-compute[75244]:   <uuid>0e2feb16-677d-4713-8646-dbed4fe33e59</uuid>
Nov 29 23:01:42 user nova-compute[75244]:   <name>instance-00000002</name>
Nov 29 23:01:42 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:01:42 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:01:42 user nova-compute[75244]:   <metadata>
Nov 29 23:01:42 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:01:42 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:01:42 user nova-compute[75244]:       <nova:name>tempest-ServersNegativeTestJSON-server-2095721698</nova:name>
Nov 29 23:01:42 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:01:42</nova:creationTime>
Nov 29 23:01:42 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:01:42 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:01:42 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:01:42 user nova-compute[75244]:       <nova:owner>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:user uuid="7f680496b0c147a48948cb1f24c65797">tempest-ServersNegativeTestJSON-1248877561-project-member</nova:user>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:project uuid="15889b42830c48049aa8537bd8e82d56">tempest-ServersNegativeTestJSON-1248877561</nova:project>
Nov 29 23:01:42 user nova-compute[75244]:       </nova:owner>
Nov 29 23:01:42 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:01:42 user nova-compute[75244]:       <nova:ports>
Nov 29 23:01:42 user nova-compute[75244]:         <nova:port uuid="856339eb-f4d3-4fce-abe7-bb017fcccbf7">
Nov 29 23:01:42 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:01:42 user nova-compute[75244]:         </nova:port>
Nov 29 23:01:42 user nova-compute[75244]:       </nova:ports>
Nov 29 23:01:42 user nova-compute[75244]:     </nova:instance>
Nov 29 23:01:42 user nova-compute[75244]:   </metadata>
Nov 29 23:01:42 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:01:42 user nova-compute[75244]:     <system>
Nov 29 23:01:42 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:01:42 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:01:42 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:01:42 user nova-compute[75244]:       <entry name="serial">0e2feb16-677d-4713-8646-dbed4fe33e59</entry>
Nov 29 23:01:42 user nova-compute[75244]:       <entry name="uuid">0e2feb16-677d-4713-8646-dbed4fe33e59</entry>
Nov 29 23:01:42 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:01:42 user nova-compute[75244]:     </system>
Nov 29 23:01:42 user nova-compute[75244]:   </sysinfo>
Nov 29 23:01:42 user nova-compute[75244]:   <os>
Nov 29 23:01:42 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:01:42 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:01:42 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:01:42 user nova-compute[75244]:   </os>
Nov 29 23:01:42 user nova-compute[75244]:   <features>
Nov 29 23:01:42 user nova-compute[75244]:     <acpi/>
Nov 29 23:01:42 user nova-compute[75244]:     <apic/>
Nov 29 23:01:42 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:01:42 user nova-compute[75244]:   </features>
Nov 29 23:01:42 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:01:42 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:01:42 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:01:42 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:01:42 user nova-compute[75244]:   </clock>
Nov 29 23:01:42 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:01:42 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:01:42 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:01:42 user nova-compute[75244]:   </cpu>
Nov 29 23:01:42 user nova-compute[75244]:   <devices>
Nov 29 23:01:42 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:01:42 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:01:42 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk"/>
Nov 29 23:01:42 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:01:42 user nova-compute[75244]:     </disk>
Nov 29 23:01:42 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:01:42 user nova-compute[75244]:       <mac address="fa:16:3e:ec:11:7e"/>
Nov 29 23:01:42 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:42 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:01:42 user nova-compute[75244]:       <target dev="tap856339eb-f4"/>
Nov 29 23:01:42 user nova-compute[75244]:     </interface>
Nov 29 23:01:42 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:01:42 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/console.log" append="off"/>
Nov 29 23:01:42 user nova-compute[75244]:     </serial>
Nov 29 23:01:42 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:01:42 user nova-compute[75244]:     <video>
Nov 29 23:01:42 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:42 user nova-compute[75244]:     </video>
Nov 29 23:01:42 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:01:42 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:01:42 user nova-compute[75244]:     </rng>
Nov 29 23:01:42 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:01:42 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:01:42 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:01:42 user nova-compute[75244]:     </memballoon>
Nov 29 23:01:42 user nova-compute[75244]:   </devices>
Nov 29 23:01:42 user nova-compute[75244]: </domain>
Nov 29 23:01:42 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2095721698',display_name='tempest-ServersNegativeTestJSON-server-2095721698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2095721698',id=2,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15889b42830c48049aa8537bd8e82d56',ramdisk_id='',reservation_id='r-0f0cv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1248877561',owner_user_name='tempest-ServersNegativeTestJSON-1248877561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:36Z,user_data=None,user_id='7f680496b0c147a48948cb1f24c65797',uuid=0e2feb16-677d-4713-8646-dbed4fe33e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converting VIF {"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG os_vif [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ec3610d-4840-50b0-969a-3a46ba59b079', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap856339eb-f4, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap856339eb-f4, col_values=(('qos', UUID('871d7914-e453-4a49-9ba1-3457568be4c6')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap856339eb-f4, col_values=(('external_ids', {'iface-id': '856339eb-f4d3-4fce-abe7-bb017fcccbf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:11:7e', 'vm-uuid': '0e2feb16-677d-4713-8646-dbed4fe33e59'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:42 user nova-compute[75244]: INFO os_vif [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4')
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:01:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] No VIF found with MAC fa:16:3e:ec:11:7e, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updated VIF entry in instance network info cache for port 856339eb-f4d3-4fce-abe7-bb017fcccbf7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updating instance_info_cache with network_info: [{"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff682893-a071-44d1-bc66-78972414af95 req-23598403-0fc9-48ac-af08-9039af7fe3a2 service nova] Releasing lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:01:46 user nova-compute[75244]: INFO nova.compute.claims [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Claim successful on node user
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:01:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:01:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 794fea73-9d39-499d-8904-7c916a669709] Instance spawned successfully.
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.policy [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aab2f432fdbf48d3bc546158221a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b3fc795bdd143a9bbb8b3d5a040e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:01:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Instance spawned successfully.
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:01:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Creating image(s)
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:46 user nova-compute[75244]: INFO nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Took 14.11 seconds to spawn the instance on the hypervisor.
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:47 user nova-compute[75244]: INFO nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Took 10.43 seconds to spawn the instance on the hypervisor.
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:01:47 user nova-compute[75244]: INFO nova.compute.manager [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Took 15.03 seconds to build instance.
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca8e355e-288a-4037-bdef-7cb26b465541 tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.446s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:47 user nova-compute[75244]: INFO nova.compute.manager [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Took 11.41 seconds to build instance.
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-30b3ca6b-5c77-47b5-a7f4-4d628e94e1a6 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.566s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.214s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk 1073741824" returned: 0 in 0.091s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:01:47 user nova-compute[75244]: INFO nova.compute.claims [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Claim successful on node user
Nov 29 23:01:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Cannot resize image /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Ensure instance console log exists: /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:01:47 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:01:48 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.policy [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe39bc0caf6f49368d0d0cb0789a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b273a67b0a2f462aa1092779f31fdc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:01:48 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Creating image(s)
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.233s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk 1073741824" returned: 0 in 0.062s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Successfully created port: 69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.268s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Cannot resize image /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Ensure instance console log exists: /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-4525514b-c0b0-4af8-b23d-1d5e4cdff662 req-83165901-4605-42d3-9394-1d686442cdd4 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4525514b-c0b0-4af8-b23d-1d5e4cdff662 req-83165901-4605-42d3-9394-1d686442cdd4 service nova] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4525514b-c0b0-4af8-b23d-1d5e4cdff662 req-83165901-4605-42d3-9394-1d686442cdd4 service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4525514b-c0b0-4af8-b23d-1d5e4cdff662 req-83165901-4605-42d3-9394-1d686442cdd4 service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-4525514b-c0b0-4af8-b23d-1d5e4cdff662 req-83165901-4605-42d3-9394-1d686442cdd4 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] No waiting events found dispatching network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:01:50 user nova-compute[75244]: WARNING nova.compute.manager [req-4525514b-c0b0-4af8-b23d-1d5e4cdff662 req-83165901-4605-42d3-9394-1d686442cdd4 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received unexpected event network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 for instance with vm_state active and task_state None.
Nov 29 23:01:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Successfully created port: 8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Successfully updated port: 69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-changed-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Refreshing instance network info cache due to event network-changed-69add1a4-a188-4454-9331-c39bffcd8b49. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:01:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:52 user nova-compute[75244]: DEBUG nova.network.neutron [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:01:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-49721423-cbf9-47be-bef6-74232b61274f req-9f66f5dd-4f9e-4fe4-8df5-77c06804895a service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49721423-cbf9-47be-bef6-74232b61274f req-9f66f5dd-4f9e-4fe4-8df5-77c06804895a service nova] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49721423-cbf9-47be-bef6-74232b61274f req-9f66f5dd-4f9e-4fe4-8df5-77c06804895a service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49721423-cbf9-47be-bef6-74232b61274f req-9f66f5dd-4f9e-4fe4-8df5-77c06804895a service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-49721423-cbf9-47be-bef6-74232b61274f req-9f66f5dd-4f9e-4fe4-8df5-77c06804895a service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] No waiting events found dispatching network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:01:53 user nova-compute[75244]: WARNING nova.compute.manager [req-49721423-cbf9-47be-bef6-74232b61274f req-9f66f5dd-4f9e-4fe4-8df5-77c06804895a service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received unexpected event network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 for instance with vm_state active and task_state None.
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.network.neutron [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance network_info: |[{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Refreshing network info cache for port 69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start _get_guest_xml network_info=[{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:01:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'pci_devices' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:01:53 user nova-compute[75244]:   <uuid>019c268b-dc0f-4e68-95e2-f26f5c24463b</uuid>
Nov 29 23:01:53 user nova-compute[75244]:   <name>instance-00000003</name>
Nov 29 23:01:53 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:01:53 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:01:53 user nova-compute[75244]:   <metadata>
Nov 29 23:01:53 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:01:53 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:01:53 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeTestJSON-server-2138708551</nova:name>
Nov 29 23:01:53 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:01:53</nova:creationTime>
Nov 29 23:01:53 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:01:53 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:01:53 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:01:53 user nova-compute[75244]:       <nova:owner>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:user uuid="aab2f432fdbf48d3bc546158221a1448">tempest-AttachVolumeTestJSON-2123642001-project-member</nova:user>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:project uuid="8b3fc795bdd143a9bbb8b3d5a040e92f">tempest-AttachVolumeTestJSON-2123642001</nova:project>
Nov 29 23:01:53 user nova-compute[75244]:       </nova:owner>
Nov 29 23:01:53 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:01:53 user nova-compute[75244]:       <nova:ports>
Nov 29 23:01:53 user nova-compute[75244]:         <nova:port uuid="69add1a4-a188-4454-9331-c39bffcd8b49">
Nov 29 23:01:53 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:01:53 user nova-compute[75244]:         </nova:port>
Nov 29 23:01:53 user nova-compute[75244]:       </nova:ports>
Nov 29 23:01:53 user nova-compute[75244]:     </nova:instance>
Nov 29 23:01:53 user nova-compute[75244]:   </metadata>
Nov 29 23:01:53 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:01:53 user nova-compute[75244]:     <system>
Nov 29 23:01:53 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:01:53 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:01:53 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:01:53 user nova-compute[75244]:       <entry name="serial">019c268b-dc0f-4e68-95e2-f26f5c24463b</entry>
Nov 29 23:01:53 user nova-compute[75244]:       <entry name="uuid">019c268b-dc0f-4e68-95e2-f26f5c24463b</entry>
Nov 29 23:01:53 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:01:53 user nova-compute[75244]:     </system>
Nov 29 23:01:53 user nova-compute[75244]:   </sysinfo>
Nov 29 23:01:53 user nova-compute[75244]:   <os>
Nov 29 23:01:53 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:01:53 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:01:53 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:01:53 user nova-compute[75244]:   </os>
Nov 29 23:01:53 user nova-compute[75244]:   <features>
Nov 29 23:01:53 user nova-compute[75244]:     <acpi/>
Nov 29 23:01:53 user nova-compute[75244]:     <apic/>
Nov 29 23:01:53 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:01:53 user nova-compute[75244]:   </features>
Nov 29 23:01:53 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:01:53 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:01:53 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:01:53 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:01:53 user nova-compute[75244]:   </clock>
Nov 29 23:01:53 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:01:53 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:01:53 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:01:53 user nova-compute[75244]:   </cpu>
Nov 29 23:01:53 user nova-compute[75244]:   <devices>
Nov 29 23:01:53 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:01:53 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:01:53 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk"/>
Nov 29 23:01:53 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:01:53 user nova-compute[75244]:     </disk>
Nov 29 23:01:53 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:01:53 user nova-compute[75244]:       <mac address="fa:16:3e:96:27:05"/>
Nov 29 23:01:53 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:53 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:01:53 user nova-compute[75244]:       <target dev="tap69add1a4-a1"/>
Nov 29 23:01:53 user nova-compute[75244]:     </interface>
Nov 29 23:01:53 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:01:53 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/console.log" append="off"/>
Nov 29 23:01:53 user nova-compute[75244]:     </serial>
Nov 29 23:01:53 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:01:53 user nova-compute[75244]:     <video>
Nov 29 23:01:53 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:53 user nova-compute[75244]:     </video>
Nov 29 23:01:53 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:01:53 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:01:53 user nova-compute[75244]:     </rng>
Nov 29 23:01:53 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:01:53 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:01:53 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:01:53 user nova-compute[75244]:     </memballoon>
Nov 29 23:01:53 user nova-compute[75244]:   </devices>
Nov 29 23:01:53 user nova-compute[75244]: </domain>
Nov 29 23:01:53 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG os_vif [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a264fd11-71ca-5439-a669-6157452ef944', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69add1a4-a1, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69add1a4-a1, col_values=(('qos', UUID('22dc88be-d1f7-4c26-bd03-73bd114778da')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69add1a4-a1, col_values=(('external_ids', {'iface-id': '69add1a4-a188-4454-9331-c39bffcd8b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:27:05', 'vm-uuid': '019c268b-dc0f-4e68-95e2-f26f5c24463b'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:53 user nova-compute[75244]: INFO os_vif [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1')
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:01:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No VIF found with MAC fa:16:3e:96:27:05, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Successfully updated port: 8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updated VIF entry in instance network info cache for port 69add1a4-a188-4454-9331-c39bffcd8b49. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c845dfee-f463-46eb-830c-1926139af65f req-275680d3-d578-40e4-8cdb-734a47be2d31 service nova] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing instance network info cache due to event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance network_info: |[{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.network.neutron [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Start _get_guest_xml network_info=[{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:01:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1788131671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1788131671',id=4,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNzGqm3Tm/ItTGGk6XBWULal6mqzkFsASAJf+ylMr6CFzo4MuiO5nKzCU24l3Av5hDkOEAqi530p07uUWailDkFtu7cEIMGGmEGgD7iMA9o9SjemlX3vcHOd9I10+fkzw==',key_name='tempest-keypair-1743157863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-oyfa3jdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=98d0cfec-ab5d-49a0-a467-f90989f51aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.objects.instance [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'pci_devices' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:01:55 user nova-compute[75244]:   <uuid>98d0cfec-ab5d-49a0-a467-f90989f51aa0</uuid>
Nov 29 23:01:55 user nova-compute[75244]:   <name>instance-00000004</name>
Nov 29 23:01:55 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:01:55 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:01:55 user nova-compute[75244]:   <metadata>
Nov 29 23:01:55 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:01:55 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:01:55 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1788131671</nova:name>
Nov 29 23:01:55 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:01:55</nova:creationTime>
Nov 29 23:01:55 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:01:55 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:01:55 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:01:55 user nova-compute[75244]:       <nova:owner>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:user uuid="fe39bc0caf6f49368d0d0cb0789a1d3c">tempest-AttachVolumeShelveTestJSON-576906296-project-member</nova:user>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:project uuid="b273a67b0a2f462aa1092779f31fdc8a">tempest-AttachVolumeShelveTestJSON-576906296</nova:project>
Nov 29 23:01:55 user nova-compute[75244]:       </nova:owner>
Nov 29 23:01:55 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:01:55 user nova-compute[75244]:       <nova:ports>
Nov 29 23:01:55 user nova-compute[75244]:         <nova:port uuid="8309daad-6231-443d-9aa1-9b46adbc6fea">
Nov 29 23:01:55 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 23:01:55 user nova-compute[75244]:         </nova:port>
Nov 29 23:01:55 user nova-compute[75244]:       </nova:ports>
Nov 29 23:01:55 user nova-compute[75244]:     </nova:instance>
Nov 29 23:01:55 user nova-compute[75244]:   </metadata>
Nov 29 23:01:55 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:01:55 user nova-compute[75244]:     <system>
Nov 29 23:01:55 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:01:55 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:01:55 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:01:55 user nova-compute[75244]:       <entry name="serial">98d0cfec-ab5d-49a0-a467-f90989f51aa0</entry>
Nov 29 23:01:55 user nova-compute[75244]:       <entry name="uuid">98d0cfec-ab5d-49a0-a467-f90989f51aa0</entry>
Nov 29 23:01:55 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:01:55 user nova-compute[75244]:     </system>
Nov 29 23:01:55 user nova-compute[75244]:   </sysinfo>
Nov 29 23:01:55 user nova-compute[75244]:   <os>
Nov 29 23:01:55 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:01:55 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:01:55 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:01:55 user nova-compute[75244]:   </os>
Nov 29 23:01:55 user nova-compute[75244]:   <features>
Nov 29 23:01:55 user nova-compute[75244]:     <acpi/>
Nov 29 23:01:55 user nova-compute[75244]:     <apic/>
Nov 29 23:01:55 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:01:55 user nova-compute[75244]:   </features>
Nov 29 23:01:55 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:01:55 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:01:55 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:01:55 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:01:55 user nova-compute[75244]:   </clock>
Nov 29 23:01:55 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:01:55 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:01:55 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:01:55 user nova-compute[75244]:   </cpu>
Nov 29 23:01:55 user nova-compute[75244]:   <devices>
Nov 29 23:01:55 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:01:55 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:01:55 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk"/>
Nov 29 23:01:55 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:01:55 user nova-compute[75244]:     </disk>
Nov 29 23:01:55 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:01:55 user nova-compute[75244]:       <mac address="fa:16:3e:a3:28:f0"/>
Nov 29 23:01:55 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:55 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:01:55 user nova-compute[75244]:       <target dev="tap8309daad-62"/>
Nov 29 23:01:55 user nova-compute[75244]:     </interface>
Nov 29 23:01:55 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:01:55 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/console.log" append="off"/>
Nov 29 23:01:55 user nova-compute[75244]:     </serial>
Nov 29 23:01:55 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:01:55 user nova-compute[75244]:     <video>
Nov 29 23:01:55 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:01:55 user nova-compute[75244]:     </video>
Nov 29 23:01:55 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:01:55 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:01:55 user nova-compute[75244]:     </rng>
Nov 29 23:01:55 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:01:55 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:01:55 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:01:55 user nova-compute[75244]:     </memballoon>
Nov 29 23:01:55 user nova-compute[75244]:   </devices>
Nov 29 23:01:55 user nova-compute[75244]: </domain>
Nov 29 23:01:55 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1788131671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1788131671',id=4,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNzGqm3Tm/ItTGGk6XBWULal6mqzkFsASAJf+ylMr6CFzo4MuiO5nKzCU24l3Av5hDkOEAqi530p07uUWailDkFtu7cEIMGGmEGgD7iMA9o9SjemlX3vcHOd9I10+fkzw==',key_name='tempest-keypair-1743157863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-oyfa3jdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=98d0cfec-ab5d-49a0-a467-f90989f51aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG os_vif [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c41b705-a957-5510-ad37-985a44f13ef7', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8309daad-62, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8309daad-62, col_values=(('qos', UUID('ccfdee93-c207-4b03-9913-870b0245222e')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8309daad-62, col_values=(('external_ids', {'iface-id': '8309daad-6231-443d-9aa1-9b46adbc6fea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:28:f0', 'vm-uuid': '98d0cfec-ab5d-49a0-a467-f90989f51aa0'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:01:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:55 user nova-compute[75244]: INFO os_vif [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62')
Nov 29 23:01:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No VIF found with MAC fa:16:3e:a3:28:f0, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-ba98bf7d-5162-43eb-9838-638f56d78c8f req-9808aec6-6db3-49b8-845e-10ecbf5a57aa service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba98bf7d-5162-43eb-9838-638f56d78c8f req-9808aec6-6db3-49b8-845e-10ecbf5a57aa service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba98bf7d-5162-43eb-9838-638f56d78c8f req-9808aec6-6db3-49b8-845e-10ecbf5a57aa service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba98bf7d-5162-43eb-9838-638f56d78c8f req-9808aec6-6db3-49b8-845e-10ecbf5a57aa service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-ba98bf7d-5162-43eb-9838-638f56d78c8f req-9808aec6-6db3-49b8-845e-10ecbf5a57aa service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:01:57 user nova-compute[75244]: WARNING nova.compute.manager [req-ba98bf7d-5162-43eb-9838-638f56d78c8f req-9808aec6-6db3-49b8-845e-10ecbf5a57aa service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state building and task_state spawning.
Nov 29 23:01:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:01:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:01:57 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance spawned successfully.
Nov 29 23:01:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updated VIF entry in instance network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-72ef94d1-bb4f-4089-9bb9-413924b2fce1 req-16679a6b-0112-42ce-96c0-068b351a62ef service nova] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:01:58 user nova-compute[75244]: INFO nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Took 11.35 seconds to spawn the instance on the hypervisor.
Nov 29 23:01:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:01:58 user nova-compute[75244]: INFO nova.compute.manager [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Took 12.25 seconds to build instance.
Nov 29 23:01:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-981e6905-abb9-442c-92cd-aff8c5a637d1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.392s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-df4e4253-3aa6-40be-b863-7a786cf5fdae req-ee576cda-711b-4c4b-9632-1a073ae2ae73 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df4e4253-3aa6-40be-b863-7a786cf5fdae req-ee576cda-711b-4c4b-9632-1a073ae2ae73 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df4e4253-3aa6-40be-b863-7a786cf5fdae req-ee576cda-711b-4c4b-9632-1a073ae2ae73 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df4e4253-3aa6-40be-b863-7a786cf5fdae req-ee576cda-711b-4c4b-9632-1a073ae2ae73 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-df4e4253-3aa6-40be-b863-7a786cf5fdae req-ee576cda-711b-4c4b-9632-1a073ae2ae73 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:01:59 user nova-compute[75244]: WARNING nova.compute.manager [req-df4e4253-3aa6-40be-b863-7a786cf5fdae req-ee576cda-711b-4c4b-9632-1a073ae2ae73 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state active and task_state None.
Nov 29 23:01:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:01:59 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:01:59 user nova-compute[75244]: INFO nova.compute.claims [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Claim successful on node user
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:02:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance spawned successfully.
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:02:00 user nova-compute[75244]: INFO nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Took 12.17 seconds to spawn the instance on the hypervisor.
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:02:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:00 user nova-compute[75244]: INFO nova.compute.manager [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Took 13.26 seconds to build instance.
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.policy [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df0d594179f64f79b1b66cbeea8bac59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefa2f1cf1914faa9c73096e1cb1b8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-678e6a9c-a03e-4e77-9901-5631cbdaa7f3 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.487s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:02:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Creating image(s)
Nov 29 23:02:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "/opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "/opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.281s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.250s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk 1073741824" returned: 0 in 0.072s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.228s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:02:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Successfully created port: 9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Cannot resize image /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Successfully updated port: 9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-changed-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Refreshing instance network info cache due to event network-changed-9c393a82-e3f5-49a4-87d6-97980abb79e9. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] Acquiring lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] Acquired lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Refreshing network info cache for port 9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2fd038a2-685c-4dc8-9b08-3d71322ae19e req-f6381982-e659-4497-8864-ba750d7b714d service nova] Releasing lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquired lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:02:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updating instance_info_cache with network_info: [{"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Releasing lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Instance network_info: |[{"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Start _get_guest_xml network_info=[{"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:02:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1955421205',display_name='tempest-VolumesAdminNegativeTest-server-1955421205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1955421205',id=5,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXxcUbuV0kuETEvl8eq4Z1VPni7CXMIIfq2d+ZtD7VTaV9fZnGqIL5lfpduVREEqLlUSt8VstWWBfS9cP0OKcDUCarV8u3h8m2V1VrXg1F9CYYzRk+BJSkeZgZkbcukfg==',key_name='tempest-keypair-906342697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa2f1cf1914faa9c73096e1cb1b8e9',ramdisk_id='',reservation_id='r-j233y8bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-778262822',owner_user_name='tempest-VolumesAdminNegativeTest-778262822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df0d594179f64f79b1b66cbeea8bac59',uuid=f2b866e9-d721-494e-b4ce-9605047d87de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converting VIF {"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.objects.instance [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b866e9-d721-494e-b4ce-9605047d87de {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:02:05 user nova-compute[75244]:   <uuid>f2b866e9-d721-494e-b4ce-9605047d87de</uuid>
Nov 29 23:02:05 user nova-compute[75244]:   <name>instance-00000005</name>
Nov 29 23:02:05 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:02:05 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:02:05 user nova-compute[75244]:   <metadata>
Nov 29 23:02:05 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:02:05 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:02:05 user nova-compute[75244]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1955421205</nova:name>
Nov 29 23:02:05 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:02:05</nova:creationTime>
Nov 29 23:02:05 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:02:05 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:02:05 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:02:05 user nova-compute[75244]:       <nova:owner>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:user uuid="df0d594179f64f79b1b66cbeea8bac59">tempest-VolumesAdminNegativeTest-778262822-project-member</nova:user>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:project uuid="cefa2f1cf1914faa9c73096e1cb1b8e9">tempest-VolumesAdminNegativeTest-778262822</nova:project>
Nov 29 23:02:05 user nova-compute[75244]:       </nova:owner>
Nov 29 23:02:05 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:02:05 user nova-compute[75244]:       <nova:ports>
Nov 29 23:02:05 user nova-compute[75244]:         <nova:port uuid="9c393a82-e3f5-49a4-87d6-97980abb79e9">
Nov 29 23:02:05 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:02:05 user nova-compute[75244]:         </nova:port>
Nov 29 23:02:05 user nova-compute[75244]:       </nova:ports>
Nov 29 23:02:05 user nova-compute[75244]:     </nova:instance>
Nov 29 23:02:05 user nova-compute[75244]:   </metadata>
Nov 29 23:02:05 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:02:05 user nova-compute[75244]:     <system>
Nov 29 23:02:05 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:02:05 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:02:05 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:02:05 user nova-compute[75244]:       <entry name="serial">f2b866e9-d721-494e-b4ce-9605047d87de</entry>
Nov 29 23:02:05 user nova-compute[75244]:       <entry name="uuid">f2b866e9-d721-494e-b4ce-9605047d87de</entry>
Nov 29 23:02:05 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:02:05 user nova-compute[75244]:     </system>
Nov 29 23:02:05 user nova-compute[75244]:   </sysinfo>
Nov 29 23:02:05 user nova-compute[75244]:   <os>
Nov 29 23:02:05 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:02:05 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:02:05 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:02:05 user nova-compute[75244]:   </os>
Nov 29 23:02:05 user nova-compute[75244]:   <features>
Nov 29 23:02:05 user nova-compute[75244]:     <acpi/>
Nov 29 23:02:05 user nova-compute[75244]:     <apic/>
Nov 29 23:02:05 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:02:05 user nova-compute[75244]:   </features>
Nov 29 23:02:05 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:02:05 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:02:05 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:02:05 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:02:05 user nova-compute[75244]:   </clock>
Nov 29 23:02:05 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:02:05 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:02:05 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:02:05 user nova-compute[75244]:   </cpu>
Nov 29 23:02:05 user nova-compute[75244]:   <devices>
Nov 29 23:02:05 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:02:05 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:02:05 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk"/>
Nov 29 23:02:05 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:02:05 user nova-compute[75244]:     </disk>
Nov 29 23:02:05 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:02:05 user nova-compute[75244]:       <mac address="fa:16:3e:b7:32:40"/>
Nov 29 23:02:05 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:05 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:02:05 user nova-compute[75244]:       <target dev="tap9c393a82-e3"/>
Nov 29 23:02:05 user nova-compute[75244]:     </interface>
Nov 29 23:02:05 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:02:05 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/console.log" append="off"/>
Nov 29 23:02:05 user nova-compute[75244]:     </serial>
Nov 29 23:02:05 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:02:05 user nova-compute[75244]:     <video>
Nov 29 23:02:05 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:05 user nova-compute[75244]:     </video>
Nov 29 23:02:05 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:02:05 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:02:05 user nova-compute[75244]:     </rng>
Nov 29 23:02:05 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:02:05 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:02:05 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:02:05 user nova-compute[75244]:     </memballoon>
Nov 29 23:02:05 user nova-compute[75244]:   </devices>
Nov 29 23:02:05 user nova-compute[75244]: </domain>
Nov 29 23:02:05 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1955421205',display_name='tempest-VolumesAdminNegativeTest-server-1955421205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1955421205',id=5,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXxcUbuV0kuETEvl8eq4Z1VPni7CXMIIfq2d+ZtD7VTaV9fZnGqIL5lfpduVREEqLlUSt8VstWWBfS9cP0OKcDUCarV8u3h8m2V1VrXg1F9CYYzRk+BJSkeZgZkbcukfg==',key_name='tempest-keypair-906342697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa2f1cf1914faa9c73096e1cb1b8e9',ramdisk_id='',reservation_id='r-j233y8bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-778262822',owner_user_name='tempest-VolumesAdminNegativeTest-778262822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df0d594179f64f79b1b66cbeea8bac59',uuid=f2b866e9-d721-494e-b4ce-9605047d87de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converting VIF {"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG os_vif [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ef0bf65-91b0-5537-beca-3cadf1719507', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c393a82-e3, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c393a82-e3, col_values=(('qos', UUID('117e734d-1ef8-4bce-a9c1-87964d47f70b')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c393a82-e3, col_values=(('external_ids', {'iface-id': '9c393a82-e3f5-49a4-87d6-97980abb79e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:32:40', 'vm-uuid': 'f2b866e9-d721-494e-b4ce-9605047d87de'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:05 user nova-compute[75244]: INFO os_vif [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3')
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No VIF found with MAC fa:16:3e:b7:32:40, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:05 user nova-compute[75244]: WARNING nova.compute.manager [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state None.
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:05 user nova-compute[75244]: WARNING nova.compute.manager [req-f34de208-43b3-46b3-8558-bc65a54e424a req-c00a0b0a-ba99-40f9-977b-9b60f6d59617 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state None.
Nov 29 23:02:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-b700b6e1-315f-4f3c-b814-b06ffaa6f21c req-24a54770-f347-449d-a609-75ea898cb088 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b700b6e1-315f-4f3c-b814-b06ffaa6f21c req-24a54770-f347-449d-a609-75ea898cb088 service nova] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b700b6e1-315f-4f3c-b814-b06ffaa6f21c req-24a54770-f347-449d-a609-75ea898cb088 service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b700b6e1-315f-4f3c-b814-b06ffaa6f21c req-24a54770-f347-449d-a609-75ea898cb088 service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-b700b6e1-315f-4f3c-b814-b06ffaa6f21c req-24a54770-f347-449d-a609-75ea898cb088 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] No waiting events found dispatching network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:07 user nova-compute[75244]: WARNING nova.compute.manager [req-b700b6e1-315f-4f3c-b814-b06ffaa6f21c req-24a54770-f347-449d-a609-75ea898cb088 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received unexpected event network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 for instance with vm_state building and task_state spawning.
Nov 29 23:02:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:02:09 user nova-compute[75244]: INFO nova.compute.claims [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Claim successful on node user
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.341s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:02:09 user nova-compute[75244]: INFO nova.compute.claims [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Claim successful on node user
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:02:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:02:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Instance spawned successfully.
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-ba19a291-1ca5-4fe0-b384-909e48b857dd req-68f2b051-5987-434f-8f0a-4e5347fda7d5 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba19a291-1ca5-4fe0-b384-909e48b857dd req-68f2b051-5987-434f-8f0a-4e5347fda7d5 service nova] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba19a291-1ca5-4fe0-b384-909e48b857dd req-68f2b051-5987-434f-8f0a-4e5347fda7d5 service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba19a291-1ca5-4fe0-b384-909e48b857dd req-68f2b051-5987-434f-8f0a-4e5347fda7d5 service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-ba19a291-1ca5-4fe0-b384-909e48b857dd req-68f2b051-5987-434f-8f0a-4e5347fda7d5 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] No waiting events found dispatching network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:10 user nova-compute[75244]: WARNING nova.compute.manager [req-ba19a291-1ca5-4fe0-b384-909e48b857dd req-68f2b051-5987-434f-8f0a-4e5347fda7d5 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received unexpected event network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 for instance with vm_state building and task_state spawning.
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:02:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Creating image(s)
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:10 user nova-compute[75244]: INFO nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Took 9.16 seconds to spawn the instance on the hypervisor.
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.policy [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bfa897438554825be52e4c5c45ea3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2123fd8af384a46bd4d6baee7f1583d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: INFO nova.compute.manager [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Took 10.55 seconds to build instance.
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.253s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-aa87f254-7f24-44b2-99bb-59f5deb89acf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.772s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.167s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:02:10 user nova-compute[75244]: INFO nova.compute.claims [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Claim successful on node user
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.network.neutron [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.255s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk 1073741824" returned: 0 in 0.051s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.policy [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '601ebd40a0dc49f4a1bebcfe1364ab03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c46e81c7a049d5bf87280388a5eadb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:02:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Creating image(s)
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "/opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "/opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "/opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "ddeb551ac769cccc4bd1a86c4c4deea85b09f8af" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "ddeb551ac769cccc4bd1a86c4c4deea85b09f8af" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:02:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Successfully created port: df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.591s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Cannot resize image /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Ensure instance console log exists: /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.part --force-share --output=json" returned: 0 in 0.234s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.virt.images [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] 543f1b7d-e52f-42d9-b88e-57125f168056 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.part /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.203s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.part /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.converted" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "ddeb551ac769cccc4bd1a86c4c4deea85b09f8af" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.192s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.policy [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db43bd663d442daa8df5180c33e952c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab4c83d749e4d5c891170e8c04ea612', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Successfully created port: 2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:02:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Creating image(s)
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "/opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "/opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af --force-share --output=json" returned: 0 in 0.340s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "ddeb551ac769cccc4bd1a86c4c4deea85b09f8af" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "ddeb551ac769cccc4bd1a86c4c4deea85b09f8af" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.026s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.307s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af --force-share --output=json" returned: 0 in 0.228s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af,backing_fmt=raw /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af,backing_fmt=raw /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk 1073741824" returned: 0 in 0.063s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "ddeb551ac769cccc4bd1a86c4c4deea85b09f8af" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Successfully updated port: df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.264s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-changed-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Refreshing instance network info cache due to event network-changed-df674a1e-ea01-45a5-8867-f3ce46592f03. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] Acquiring lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] Acquired lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Refreshing network info cache for port df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk 1073741824" returned: 0 in 0.083s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af --force-share --output=json" returned: 0 in 0.248s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.252s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Successfully updated port: 2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Cannot resize image /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Ensure instance console log exists: /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquired lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-changed-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Refreshing instance network info cache due to event network-changed-2e3817c7-d46e-4da7-aecc-6ae6402a3be6. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] Acquiring lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f091e73-5747-4254-9060-8907e94fb71b req-1764dd67-bde5-4b77-bdf7-f3bbc4318537 service nova] Releasing lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquired lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:02:13 user nova-compute[75244]: INFO nova.compute.claims [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Claim successful on node user
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Cannot resize image /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Ensure instance console log exists: /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Successfully created port: ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updating instance_info_cache with network_info: [{"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Releasing lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Instance network_info: |[{"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] Acquired lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Refreshing network info cache for port 2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Start _get_guest_xml network_info=[{"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T23:02:00Z,direct_url=<?>,disk_format='qcow2',id=543f1b7d-e52f-42d9-b88e-57125f168056,min_disk=0,min_ram=0,name='',owner='82a49c9cc67842498bd61262cb061558',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T23:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'image_id': '543f1b7d-e52f-42d9-b88e-57125f168056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:02:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T23:02:00Z,direct_url=<?>,disk_format='qcow2',id=543f1b7d-e52f-42d9-b88e-57125f168056,min_disk=0,min_ram=0,name='',owner='82a49c9cc67842498bd61262cb061558',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T23:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-735061721',display_name='tempest-AttachSCSIVolumeTestJSON-server-735061721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-735061721',id=7,image_ref='543f1b7d-e52f-42d9-b88e-57125f168056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvqbCuMOl76MHSgUKbG8YSy4MKvBXV48vOemvrxJA9ocN34QDMRpL/tnc0CAfc0uGidFU3w2gSL3G4Q1lpmZwqzbaEfYQjEObyEF+zl0baaL1eQra3Q27ip8/SRwfxEkA==',key_name='tempest-keypair-29109217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15c46e81c7a049d5bf87280388a5eadb',ramdisk_id='',reservation_id='r-lrjtzb9g',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='543f1b7d-e52f-42d9-b88e-57125f168056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1007098860',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1007098860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='601ebd40a0dc49f4a1bebcfe1364ab03',uuid=52205529-6ed5-42f2-b29d-88d4f4b1718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Converting VIF {"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lazy-loading 'pci_devices' on Instance uuid 52205529-6ed5-42f2-b29d-88d4f4b1718e {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:02:13 user nova-compute[75244]:   <uuid>52205529-6ed5-42f2-b29d-88d4f4b1718e</uuid>
Nov 29 23:02:13 user nova-compute[75244]:   <name>instance-00000007</name>
Nov 29 23:02:13 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:02:13 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:02:13 user nova-compute[75244]:   <metadata>
Nov 29 23:02:13 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:02:13 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:02:13 user nova-compute[75244]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-735061721</nova:name>
Nov 29 23:02:13 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:02:13</nova:creationTime>
Nov 29 23:02:13 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:02:13 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:02:13 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:02:13 user nova-compute[75244]:       <nova:owner>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:user uuid="601ebd40a0dc49f4a1bebcfe1364ab03">tempest-AttachSCSIVolumeTestJSON-1007098860-project-member</nova:user>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:project uuid="15c46e81c7a049d5bf87280388a5eadb">tempest-AttachSCSIVolumeTestJSON-1007098860</nova:project>
Nov 29 23:02:13 user nova-compute[75244]:       </nova:owner>
Nov 29 23:02:13 user nova-compute[75244]:       <nova:root type="image" uuid="543f1b7d-e52f-42d9-b88e-57125f168056"/>
Nov 29 23:02:13 user nova-compute[75244]:       <nova:ports>
Nov 29 23:02:13 user nova-compute[75244]:         <nova:port uuid="2e3817c7-d46e-4da7-aecc-6ae6402a3be6">
Nov 29 23:02:13 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 23:02:13 user nova-compute[75244]:         </nova:port>
Nov 29 23:02:13 user nova-compute[75244]:       </nova:ports>
Nov 29 23:02:13 user nova-compute[75244]:     </nova:instance>
Nov 29 23:02:13 user nova-compute[75244]:   </metadata>
Nov 29 23:02:13 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:02:13 user nova-compute[75244]:     <system>
Nov 29 23:02:13 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:02:13 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:02:13 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:02:13 user nova-compute[75244]:       <entry name="serial">52205529-6ed5-42f2-b29d-88d4f4b1718e</entry>
Nov 29 23:02:13 user nova-compute[75244]:       <entry name="uuid">52205529-6ed5-42f2-b29d-88d4f4b1718e</entry>
Nov 29 23:02:13 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:02:13 user nova-compute[75244]:     </system>
Nov 29 23:02:13 user nova-compute[75244]:   </sysinfo>
Nov 29 23:02:13 user nova-compute[75244]:   <os>
Nov 29 23:02:13 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:02:13 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:02:13 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:02:13 user nova-compute[75244]:   </os>
Nov 29 23:02:13 user nova-compute[75244]:   <features>
Nov 29 23:02:13 user nova-compute[75244]:     <acpi/>
Nov 29 23:02:13 user nova-compute[75244]:     <apic/>
Nov 29 23:02:13 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:02:13 user nova-compute[75244]:   </features>
Nov 29 23:02:13 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:02:13 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:02:13 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:02:13 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:02:13 user nova-compute[75244]:   </clock>
Nov 29 23:02:13 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:02:13 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:02:13 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:02:13 user nova-compute[75244]:   </cpu>
Nov 29 23:02:13 user nova-compute[75244]:   <devices>
Nov 29 23:02:13 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:02:13 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:02:13 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk"/>
Nov 29 23:02:13 user nova-compute[75244]:       <target dev="sda" bus="scsi"/>
Nov 29 23:02:13 user nova-compute[75244]:       <address type="drive" controller="0" unit="0"/>
Nov 29 23:02:13 user nova-compute[75244]:     </disk>
Nov 29 23:02:13 user nova-compute[75244]:     <disk type="file" device="cdrom">
Nov 29 23:02:13 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 23:02:13 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.config"/>
Nov 29 23:02:13 user nova-compute[75244]:       <target dev="sdb" bus="scsi"/>
Nov 29 23:02:13 user nova-compute[75244]:       <address type="drive" controller="0" unit="1"/>
Nov 29 23:02:13 user nova-compute[75244]:     </disk>
Nov 29 23:02:13 user nova-compute[75244]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 23:02:13 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:02:13 user nova-compute[75244]:       <mac address="fa:16:3e:ea:a6:d4"/>
Nov 29 23:02:13 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:13 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:02:13 user nova-compute[75244]:       <target dev="tap2e3817c7-d4"/>
Nov 29 23:02:13 user nova-compute[75244]:     </interface>
Nov 29 23:02:13 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:02:13 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/console.log" append="off"/>
Nov 29 23:02:13 user nova-compute[75244]:     </serial>
Nov 29 23:02:13 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:02:13 user nova-compute[75244]:     <video>
Nov 29 23:02:13 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:13 user nova-compute[75244]:     </video>
Nov 29 23:02:13 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:02:13 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:02:13 user nova-compute[75244]:     </rng>
Nov 29 23:02:13 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:02:13 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:02:13 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:02:13 user nova-compute[75244]:     </memballoon>
Nov 29 23:02:13 user nova-compute[75244]:   </devices>
Nov 29 23:02:13 user nova-compute[75244]: </domain>
Nov 29 23:02:13 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-735061721',display_name='tempest-AttachSCSIVolumeTestJSON-server-735061721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-735061721',id=7,image_ref='543f1b7d-e52f-42d9-b88e-57125f168056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvqbCuMOl76MHSgUKbG8YSy4MKvBXV48vOemvrxJA9ocN34QDMRpL/tnc0CAfc0uGidFU3w2gSL3G4Q1lpmZwqzbaEfYQjEObyEF+zl0baaL1eQra3Q27ip8/SRwfxEkA==',key_name='tempest-keypair-29109217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15c46e81c7a049d5bf87280388a5eadb',ramdisk_id='',reservation_id='r-lrjtzb9g',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='543f1b7d-e52f-42d9-b88e-57125f168056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1007098860',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1007098860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='601ebd40a0dc49f4a1bebcfe1364ab03',uuid=52205529-6ed5-42f2-b29d-88d4f4b1718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Converting VIF {"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG os_vif [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbf76376-868f-5b4a-af96-f8871fa55eed', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e3817c7-d4, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e3817c7-d4, col_values=(('qos', UUID('31319e8b-783d-49d6-8fea-e9b2aeae978a')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e3817c7-d4, col_values=(('external_ids', {'iface-id': '2e3817c7-d46e-4da7-aecc-6ae6402a3be6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a6:d4', 'vm-uuid': '52205529-6ed5-42f2-b29d-88d4f4b1718e'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:14 user nova-compute[75244]: INFO os_vif [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4')
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Releasing lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Instance network_info: |[{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Start _get_guest_xml network_info=[{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:02:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No BDM found with device name sda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No VIF found with MAC fa:16:3e:ea:a6:d4, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:02:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Using config drive
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'pci_devices' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:02:14 user nova-compute[75244]:   <uuid>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</uuid>
Nov 29 23:02:14 user nova-compute[75244]:   <name>instance-00000006</name>
Nov 29 23:02:14 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:02:14 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:02:14 user nova-compute[75244]:   <metadata>
Nov 29 23:02:14 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:02:14 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:02:14 user nova-compute[75244]:       <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:02:14 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:02:14</nova:creationTime>
Nov 29 23:02:14 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:02:14 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:02:14 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:02:14 user nova-compute[75244]:       <nova:owner>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:02:14 user nova-compute[75244]:       </nova:owner>
Nov 29 23:02:14 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:02:14 user nova-compute[75244]:       <nova:ports>
Nov 29 23:02:14 user nova-compute[75244]:         <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:02:14 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:02:14 user nova-compute[75244]:         </nova:port>
Nov 29 23:02:14 user nova-compute[75244]:       </nova:ports>
Nov 29 23:02:14 user nova-compute[75244]:     </nova:instance>
Nov 29 23:02:14 user nova-compute[75244]:   </metadata>
Nov 29 23:02:14 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:02:14 user nova-compute[75244]:     <system>
Nov 29 23:02:14 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:02:14 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:02:14 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:02:14 user nova-compute[75244]:       <entry name="serial">c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:02:14 user nova-compute[75244]:       <entry name="uuid">c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:02:14 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:02:14 user nova-compute[75244]:     </system>
Nov 29 23:02:14 user nova-compute[75244]:   </sysinfo>
Nov 29 23:02:14 user nova-compute[75244]:   <os>
Nov 29 23:02:14 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:02:14 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:02:14 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:02:14 user nova-compute[75244]:   </os>
Nov 29 23:02:14 user nova-compute[75244]:   <features>
Nov 29 23:02:14 user nova-compute[75244]:     <acpi/>
Nov 29 23:02:14 user nova-compute[75244]:     <apic/>
Nov 29 23:02:14 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:02:14 user nova-compute[75244]:   </features>
Nov 29 23:02:14 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:02:14 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:02:14 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:02:14 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:02:14 user nova-compute[75244]:   </clock>
Nov 29 23:02:14 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:02:14 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:02:14 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:02:14 user nova-compute[75244]:   </cpu>
Nov 29 23:02:14 user nova-compute[75244]:   <devices>
Nov 29 23:02:14 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:02:14 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:02:14 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk"/>
Nov 29 23:02:14 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:02:14 user nova-compute[75244]:     </disk>
Nov 29 23:02:14 user nova-compute[75244]:     <disk type="file" device="cdrom">
Nov 29 23:02:14 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 23:02:14 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config"/>
Nov 29 23:02:14 user nova-compute[75244]:       <target dev="hda" bus="ide"/>
Nov 29 23:02:14 user nova-compute[75244]:     </disk>
Nov 29 23:02:14 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:02:14 user nova-compute[75244]:       <mac address="fa:16:3e:37:d9:57"/>
Nov 29 23:02:14 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:14 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:02:14 user nova-compute[75244]:       <target dev="tapdf674a1e-ea"/>
Nov 29 23:02:14 user nova-compute[75244]:     </interface>
Nov 29 23:02:14 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:02:14 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log" append="off"/>
Nov 29 23:02:14 user nova-compute[75244]:     </serial>
Nov 29 23:02:14 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:02:14 user nova-compute[75244]:     <video>
Nov 29 23:02:14 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:14 user nova-compute[75244]:     </video>
Nov 29 23:02:14 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:02:14 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:02:14 user nova-compute[75244]:     </rng>
Nov 29 23:02:14 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:02:14 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:02:14 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:02:14 user nova-compute[75244]:     </memballoon>
Nov 29 23:02:14 user nova-compute[75244]:   </devices>
Nov 29 23:02:14 user nova-compute[75244]: </domain>
Nov 29 23:02:14 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG os_vif [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f6b5af-7e2c-5288-9556-52b74746ee65', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf674a1e-ea, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf674a1e-ea, col_values=(('qos', UUID('d858af7f-a08c-4f94-9a72-dcb52c7967db')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf674a1e-ea, col_values=(('external_ids', {'iface-id': 'df674a1e-ea01-45a5-8867-f3ce46592f03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:d9:57', 'vm-uuid': 'c81a4813-3b3c-4bf1-a3fe-d623aab59a1c'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.906s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: INFO os_vif [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea')
Nov 29 23:02:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Creating config drive at /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.config
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgcxtjyrl {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgcxtjyrl" returned: 0 in 0.071s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:02:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No BDM found with device name hda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No VIF found with MAC fa:16:3e:37:d9:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:02:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Using config drive
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updated VIF entry in instance network info cache for port 2e3817c7-d46e-4da7-aecc-6ae6402a3be6. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updating instance_info_cache with network_info: [{"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1b93d5b-a295-4f4b-8fe1-d7ef90a7fd0b req-91a1b698-ab88-411a-983e-9c4ee9f68c41 service nova] Releasing lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.policy [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c7a58e318d44c5b7ef12c5ecab830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624dca89c97425e9abaf886236ab957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:02:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Creating image(s)
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "/opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "/opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "/opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Creating config drive at /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_2b9gvym {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Successfully updated port: ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_2b9gvym" returned: 0 in 0.080s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquired lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.231s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk 1073741824" returned: 0 in 0.077s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-changed-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Refreshing instance network info cache due to event network-changed-ff31a3d0-b874-45be-b780-cfa11a7053d0. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] Acquiring lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.237s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Successfully created port: 7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Cannot resize image /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Ensure instance console log exists: /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updating instance_info_cache with network_info: [{"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Releasing lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Instance network_info: |[{"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] Acquired lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Refreshing network info cache for port ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Start _get_guest_xml network_info=[{"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:02:16 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:16 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2046836676',display_name='tempest-TestVolumeSwap-server-2046836676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2046836676',id=8,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzXotpmqZakhy67laNJ0F1VKq4x1KYZte1IwmhKNBgWPyJV9sojFCmFVUOK8MGqkhQl1QKc0KVfqd//YW9LbmqLRwCgBnGDkxwsMzfi+VlK4+1rS5/okJvA7kDJxPvPAA==',key_name='tempest-keypair-1093743525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4c83d749e4d5c891170e8c04ea612',ramdisk_id='',reservation_id='r-008edy24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1495091483',owner_user_name='tempest-TestVolumeSwap-1495091483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db43bd663d442daa8df5180c33e952c',uuid=f0ba7f3a-d135-415c-a9dd-38c568e26e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Converting VIF {"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lazy-loading 'pci_devices' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:02:16 user nova-compute[75244]:   <uuid>f0ba7f3a-d135-415c-a9dd-38c568e26e15</uuid>
Nov 29 23:02:16 user nova-compute[75244]:   <name>instance-00000008</name>
Nov 29 23:02:16 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:02:16 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:02:16 user nova-compute[75244]:   <metadata>
Nov 29 23:02:16 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:02:16 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:02:16 user nova-compute[75244]:       <nova:name>tempest-TestVolumeSwap-server-2046836676</nova:name>
Nov 29 23:02:16 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:02:16</nova:creationTime>
Nov 29 23:02:16 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:02:16 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:02:16 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:02:16 user nova-compute[75244]:       <nova:owner>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:user uuid="6db43bd663d442daa8df5180c33e952c">tempest-TestVolumeSwap-1495091483-project-member</nova:user>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:project uuid="0ab4c83d749e4d5c891170e8c04ea612">tempest-TestVolumeSwap-1495091483</nova:project>
Nov 29 23:02:16 user nova-compute[75244]:       </nova:owner>
Nov 29 23:02:16 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:02:16 user nova-compute[75244]:       <nova:ports>
Nov 29 23:02:16 user nova-compute[75244]:         <nova:port uuid="ff31a3d0-b874-45be-b780-cfa11a7053d0">
Nov 29 23:02:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 23:02:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:02:16 user nova-compute[75244]:       </nova:ports>
Nov 29 23:02:16 user nova-compute[75244]:     </nova:instance>
Nov 29 23:02:16 user nova-compute[75244]:   </metadata>
Nov 29 23:02:16 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:02:16 user nova-compute[75244]:     <system>
Nov 29 23:02:16 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:02:16 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:02:16 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:02:16 user nova-compute[75244]:       <entry name="serial">f0ba7f3a-d135-415c-a9dd-38c568e26e15</entry>
Nov 29 23:02:16 user nova-compute[75244]:       <entry name="uuid">f0ba7f3a-d135-415c-a9dd-38c568e26e15</entry>
Nov 29 23:02:16 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:02:16 user nova-compute[75244]:     </system>
Nov 29 23:02:16 user nova-compute[75244]:   </sysinfo>
Nov 29 23:02:16 user nova-compute[75244]:   <os>
Nov 29 23:02:16 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:02:16 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:02:16 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:02:16 user nova-compute[75244]:   </os>
Nov 29 23:02:16 user nova-compute[75244]:   <features>
Nov 29 23:02:16 user nova-compute[75244]:     <acpi/>
Nov 29 23:02:16 user nova-compute[75244]:     <apic/>
Nov 29 23:02:16 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:02:16 user nova-compute[75244]:   </features>
Nov 29 23:02:16 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:02:16 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:02:16 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:02:16 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:02:16 user nova-compute[75244]:   </clock>
Nov 29 23:02:16 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:02:16 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:02:16 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:02:16 user nova-compute[75244]:   </cpu>
Nov 29 23:02:16 user nova-compute[75244]:   <devices>
Nov 29 23:02:16 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:02:16 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:02:16 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk"/>
Nov 29 23:02:16 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:02:16 user nova-compute[75244]:     </disk>
Nov 29 23:02:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:02:16 user nova-compute[75244]:       <mac address="fa:16:3e:36:c5:36"/>
Nov 29 23:02:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:02:16 user nova-compute[75244]:       <target dev="tapff31a3d0-b8"/>
Nov 29 23:02:16 user nova-compute[75244]:     </interface>
Nov 29 23:02:16 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:02:16 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/console.log" append="off"/>
Nov 29 23:02:16 user nova-compute[75244]:     </serial>
Nov 29 23:02:16 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:02:16 user nova-compute[75244]:     <video>
Nov 29 23:02:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:16 user nova-compute[75244]:     </video>
Nov 29 23:02:16 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:02:16 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:02:16 user nova-compute[75244]:     </rng>
Nov 29 23:02:16 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:02:16 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:02:16 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:02:16 user nova-compute[75244]:     </memballoon>
Nov 29 23:02:16 user nova-compute[75244]:   </devices>
Nov 29 23:02:16 user nova-compute[75244]: </domain>
Nov 29 23:02:16 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2046836676',display_name='tempest-TestVolumeSwap-server-2046836676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2046836676',id=8,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzXotpmqZakhy67laNJ0F1VKq4x1KYZte1IwmhKNBgWPyJV9sojFCmFVUOK8MGqkhQl1QKc0KVfqd//YW9LbmqLRwCgBnGDkxwsMzfi+VlK4+1rS5/okJvA7kDJxPvPAA==',key_name='tempest-keypair-1093743525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4c83d749e4d5c891170e8c04ea612',ramdisk_id='',reservation_id='r-008edy24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1495091483',owner_user_name='tempest-TestVolumeSwap-1495091483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db43bd663d442daa8df5180c33e952c',uuid=f0ba7f3a-d135-415c-a9dd-38c568e26e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Converting VIF {"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG os_vif [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e684cec-39a3-5ce7-a929-2d21205292ab', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff31a3d0-b8, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff31a3d0-b8, col_values=(('qos', UUID('3a4fa454-0d55-4d34-a4e6-6c0baff7cba1')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff31a3d0-b8, col_values=(('external_ids', {'iface-id': 'ff31a3d0-b874-45be-b780-cfa11a7053d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:c5:36', 'vm-uuid': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:16 user nova-compute[75244]: INFO os_vif [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8')
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] No VIF found with MAC fa:16:3e:36:c5:36, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:02:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Successfully updated port: 7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-changed-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Refreshing instance network info cache due to event network-changed-7156989c-5e7f-44b1-986e-6a0e3b698c94. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] Acquiring lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] Acquired lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Refreshing network info cache for port 7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updated VIF entry in instance network info cache for port ff31a3d0-b874-45be-b780-cfa11a7053d0. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updating instance_info_cache with network_info: [{"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a05fd242-448a-4792-8e0b-8eb4e1f98c86 req-69a32c1d-5349-4dba-9d1f-d5e60965af73 service nova] Releasing lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6bdf7352-ab48-46d8-be3b-fd8511ec9827 req-985ced12-c661-40a2-b83b-42b979fed562 service nova] Releasing lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquired lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] No waiting events found dispatching network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:17 user nova-compute[75244]: WARNING nova.compute.manager [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received unexpected event network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c for instance with vm_state active and task_state None.
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] No waiting events found dispatching network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:17 user nova-compute[75244]: WARNING nova.compute.manager [req-259e2ef2-86cf-4a4b-8dc3-46f2c19fd610 req-9bdc3554-739f-4dec-9466-ed47041c7a00 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received unexpected event network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c for instance with vm_state active and task_state None.
Nov 29 23:02:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Updating instance_info_cache with network_info: [{"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Releasing lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Instance network_info: |[{"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Start _get_guest_xml network_info=[{"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:02:18 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:18 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1540542304',display_name='tempest-VolumesAssistedSnapshotsTest-server-1540542304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1540542304',id=9,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Q+7ybsmSnwf/ssdUZcvAa1Cj5w+vTXNluFaZgqVkbBtX1uKS3Qr4buQHE543ijAkRy21qa3y7JDWDOXmD8Pv+DNI7HuV7v1biNwLHLDmMtshscG6abWKRpSGOWto7HA==',key_name='tempest-keypair-2029322343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d624dca89c97425e9abaf886236ab957',ramdisk_id='',reservation_id='r-wtj3mi15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1699476414',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1699476414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c7a58e318d44c5b7ef12c5ecab830e',uuid=75dbc99c-86b4-408b-b35e-be8365c8fcf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Converting VIF {"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.objects.instance [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lazy-loading 'pci_devices' on Instance uuid 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:02:18 user nova-compute[75244]:   <uuid>75dbc99c-86b4-408b-b35e-be8365c8fcf6</uuid>
Nov 29 23:02:18 user nova-compute[75244]:   <name>instance-00000009</name>
Nov 29 23:02:18 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:02:18 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:02:18 user nova-compute[75244]:   <metadata>
Nov 29 23:02:18 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:02:18 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:02:18 user nova-compute[75244]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1540542304</nova:name>
Nov 29 23:02:18 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:02:18</nova:creationTime>
Nov 29 23:02:18 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:02:18 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:02:18 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:02:18 user nova-compute[75244]:       <nova:owner>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:user uuid="36c7a58e318d44c5b7ef12c5ecab830e">tempest-VolumesAssistedSnapshotsTest-1699476414-project-member</nova:user>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:project uuid="d624dca89c97425e9abaf886236ab957">tempest-VolumesAssistedSnapshotsTest-1699476414</nova:project>
Nov 29 23:02:18 user nova-compute[75244]:       </nova:owner>
Nov 29 23:02:18 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:02:18 user nova-compute[75244]:       <nova:ports>
Nov 29 23:02:18 user nova-compute[75244]:         <nova:port uuid="7156989c-5e7f-44b1-986e-6a0e3b698c94">
Nov 29 23:02:18 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 23:02:18 user nova-compute[75244]:         </nova:port>
Nov 29 23:02:18 user nova-compute[75244]:       </nova:ports>
Nov 29 23:02:18 user nova-compute[75244]:     </nova:instance>
Nov 29 23:02:18 user nova-compute[75244]:   </metadata>
Nov 29 23:02:18 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:02:18 user nova-compute[75244]:     <system>
Nov 29 23:02:18 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:02:18 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:02:18 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:02:18 user nova-compute[75244]:       <entry name="serial">75dbc99c-86b4-408b-b35e-be8365c8fcf6</entry>
Nov 29 23:02:18 user nova-compute[75244]:       <entry name="uuid">75dbc99c-86b4-408b-b35e-be8365c8fcf6</entry>
Nov 29 23:02:18 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:02:18 user nova-compute[75244]:     </system>
Nov 29 23:02:18 user nova-compute[75244]:   </sysinfo>
Nov 29 23:02:18 user nova-compute[75244]:   <os>
Nov 29 23:02:18 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:02:18 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:02:18 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:02:18 user nova-compute[75244]:   </os>
Nov 29 23:02:18 user nova-compute[75244]:   <features>
Nov 29 23:02:18 user nova-compute[75244]:     <acpi/>
Nov 29 23:02:18 user nova-compute[75244]:     <apic/>
Nov 29 23:02:18 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:02:18 user nova-compute[75244]:   </features>
Nov 29 23:02:18 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:02:18 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:02:18 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:02:18 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:02:18 user nova-compute[75244]:   </clock>
Nov 29 23:02:18 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:02:18 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:02:18 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:02:18 user nova-compute[75244]:   </cpu>
Nov 29 23:02:18 user nova-compute[75244]:   <devices>
Nov 29 23:02:18 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:02:18 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:02:18 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk"/>
Nov 29 23:02:18 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:02:18 user nova-compute[75244]:     </disk>
Nov 29 23:02:18 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:02:18 user nova-compute[75244]:       <mac address="fa:16:3e:23:28:c0"/>
Nov 29 23:02:18 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:18 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:02:18 user nova-compute[75244]:       <target dev="tap7156989c-5e"/>
Nov 29 23:02:18 user nova-compute[75244]:     </interface>
Nov 29 23:02:18 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:02:18 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/console.log" append="off"/>
Nov 29 23:02:18 user nova-compute[75244]:     </serial>
Nov 29 23:02:18 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:02:18 user nova-compute[75244]:     <video>
Nov 29 23:02:18 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:02:18 user nova-compute[75244]:     </video>
Nov 29 23:02:18 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:02:18 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:02:18 user nova-compute[75244]:     </rng>
Nov 29 23:02:18 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:02:18 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:02:18 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:02:18 user nova-compute[75244]:     </memballoon>
Nov 29 23:02:18 user nova-compute[75244]:   </devices>
Nov 29 23:02:18 user nova-compute[75244]: </domain>
Nov 29 23:02:18 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1540542304',display_name='tempest-VolumesAssistedSnapshotsTest-server-1540542304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1540542304',id=9,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Q+7ybsmSnwf/ssdUZcvAa1Cj5w+vTXNluFaZgqVkbBtX1uKS3Qr4buQHE543ijAkRy21qa3y7JDWDOXmD8Pv+DNI7HuV7v1biNwLHLDmMtshscG6abWKRpSGOWto7HA==',key_name='tempest-keypair-2029322343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d624dca89c97425e9abaf886236ab957',ramdisk_id='',reservation_id='r-wtj3mi15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1699476414',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1699476414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c7a58e318d44c5b7ef12c5ecab830e',uuid=75dbc99c-86b4-408b-b35e-be8365c8fcf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Converting VIF {"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG os_vif [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d0c4c25-e7b0-5855-8630-5c208a7134f8', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7156989c-5e, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7156989c-5e, col_values=(('qos', UUID('1e4c8bff-0c5c-43c0-b849-5556cef42823')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7156989c-5e, col_values=(('external_ids', {'iface-id': '7156989c-5e7f-44b1-986e-6a0e3b698c94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:28:c0', 'vm-uuid': '75dbc99c-86b4-408b-b35e-be8365c8fcf6'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: INFO os_vif [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e')
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] No VIF found with MAC fa:16:3e:23:28:c0, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-6d799cc5-b177-4378-b003-36efec9886b2 req-5a514cfd-3a2e-4d69-a6be-27549a49eb7a service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6d799cc5-b177-4378-b003-36efec9886b2 req-5a514cfd-3a2e-4d69-a6be-27549a49eb7a service nova] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6d799cc5-b177-4378-b003-36efec9886b2 req-5a514cfd-3a2e-4d69-a6be-27549a49eb7a service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6d799cc5-b177-4378-b003-36efec9886b2 req-5a514cfd-3a2e-4d69-a6be-27549a49eb7a service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-6d799cc5-b177-4378-b003-36efec9886b2 req-5a514cfd-3a2e-4d69-a6be-27549a49eb7a service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] No waiting events found dispatching network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:20 user nova-compute[75244]: WARNING nova.compute.manager [req-6d799cc5-b177-4378-b003-36efec9886b2 req-5a514cfd-3a2e-4d69-a6be-27549a49eb7a service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received unexpected event network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 for instance with vm_state building and task_state spawning.
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] No waiting events found dispatching network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:22 user nova-compute[75244]: WARNING nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received unexpected event network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 for instance with vm_state building and task_state spawning.
Nov 29 23:02:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] No waiting events found dispatching network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:22 user nova-compute[75244]: WARNING nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received unexpected event network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 for instance with vm_state building and task_state spawning.
Nov 29 23:02:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] No waiting events found dispatching network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:22 user nova-compute[75244]: WARNING nova.compute.manager [req-7d603836-1463-4073-8023-93347e734cd8 req-edcd8d8f-096c-44ad-8920-edb7cc74bb35 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received unexpected event network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 for instance with vm_state building and task_state spawning.
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:02:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Instance spawned successfully.
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:23 user nova-compute[75244]: INFO nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Took 12.60 seconds to spawn the instance on the hypervisor.
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:02:23 user nova-compute[75244]: INFO nova.compute.manager [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Took 14.16 seconds to build instance.
Nov 29 23:02:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-71e793e9-8764-4d8d-8264-e4a94f53052c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.316s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:02:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Instance spawned successfully.
Nov 29 23:02:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Took 14.10 seconds to spawn the instance on the hypervisor.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Instance spawned successfully.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Instance spawned successfully.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.compute.manager [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Took 15.05 seconds to build instance.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6602d94f-87c1-4680-8862-f5a33531e016 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.214s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Took 12.20 seconds to spawn the instance on the hypervisor.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Took 9.59 seconds to spawn the instance on the hypervisor.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.compute.manager [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Took 14.23 seconds to build instance.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8acb614e-b4b7-46bc-affe-e08751d1bfe8 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.355s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:24 user nova-compute[75244]: INFO nova.compute.manager [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Took 11.29 seconds to build instance.
Nov 29 23:02:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-287bdc67-3781-4adc-a5df-62bf6ffe2b8f tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.548s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:34 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:34 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=25.583290100097656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a345778-37fc-4de2-b49f-4be01dd47e84 req-a8ced07c-53b0-4c0d-8d1b-3f9ff07645e1 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a345778-37fc-4de2-b49f-4be01dd47e84 req-a8ced07c-53b0-4c0d-8d1b-3f9ff07645e1 service nova] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a345778-37fc-4de2-b49f-4be01dd47e84 req-a8ced07c-53b0-4c0d-8d1b-3f9ff07645e1 service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a345778-37fc-4de2-b49f-4be01dd47e84 req-a8ced07c-53b0-4c0d-8d1b-3f9ff07645e1 service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a345778-37fc-4de2-b49f-4be01dd47e84 req-a8ced07c-53b0-4c0d-8d1b-3f9ff07645e1 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] No waiting events found dispatching network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:34 user nova-compute[75244]: WARNING nova.compute.manager [req-1a345778-37fc-4de2-b49f-4be01dd47e84 req-a8ced07c-53b0-4c0d-8d1b-3f9ff07645e1 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received unexpected event network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 for instance with vm_state active and task_state None.
Nov 29 23:02:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 794fea73-9d39-499d-8904-7c916a669709 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f2b866e9-d721-494e-b4ce-9605047d87de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 52205529-6ed5-42f2-b29d-88d4f4b1718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:34 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:02:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 794fea73-9d39-499d-8904-7c916a669709] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 794fea73-9d39-499d-8904-7c916a669709 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] No waiting events found dispatching network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:36 user nova-compute[75244]: WARNING nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received unexpected event network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 for instance with vm_state active and task_state None.
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:36 user nova-compute[75244]: WARNING nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 for instance with vm_state active and task_state None.
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:02:36 user nova-compute[75244]: WARNING nova.compute.manager [req-801bb224-3d2f-4697-a1a3-4bea909b003e req-4895c892-687d-440e-ab9f-b97eebf6e49d service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 for instance with vm_state active and task_state None.
Nov 29 23:02:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updating instance_info_cache with network_info: [{"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-794fea73-9d39-499d-8904-7c916a669709" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:02:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:02:44 user nova-compute[75244]: INFO nova.compute.claims [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Claim successful on node user
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:02:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:02:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:02:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:02:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:02:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:02:45 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:02:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:02:45 user nova-compute[75244]: INFO nova.virt.block_device [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Booting with volume 1adbe548-5aaf-4aff-96b5-d3b1d733a62c at /dev/vda
Nov 29 23:02:45 user nova-compute[75244]: DEBUG nova.policy [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5a33c7b60c142e3bd7ab47024678e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7769278e5e9f4143aa262b52dce8e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:02:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:02:45 user nova-compute[75244]: INFO oslo.privsep.daemon [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxd6bb9zu/privsep.sock']
Nov 29 23:02:45 user sudo[86351]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxd6bb9zu/privsep.sock
Nov 29 23:02:45 user sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 23:02:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully created port: 330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully created port: 15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:46 user sudo[86351]: pam_unix(sudo:session): session closed for user root
Nov 29 23:02:46 user nova-compute[75244]: INFO oslo.privsep.daemon [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Spawned new privsep daemon via rootwrap
Nov 29 23:02:46 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 23:02:46 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 23:02:46 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 23:02:46 user nova-compute[75244]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86356
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b14480d-57a4-4604-8c50-76e678edbca7]: (2,) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[621caf9b-d0f1-4ca8-8c1d-9917bd2f9b2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.nvmeof [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[578720dc-8c39-4e6c-8aa6-dd53df7f0562]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc6320-7eb5-4172-b8ae-7ebe3de13f40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a6ce2-f393-4148-89a7-638a6d2d8158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:02:47 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:02:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bb8769-4bbc-44a8-881a-94254b9bcdc7]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG os_brick.utils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== get_connector_properties: return (1779ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating existing volume attachment record: 23a59328-a2da-48cc-afac-b451b79f9bd2 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:02:47 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully created port: f3582003-456d-4661-9129-95140451254b {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully created port: b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully created port: 2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: 330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG nova.compute.manager [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG nova.compute.manager [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-330c9b41-e54a-463e-afa8-d021a11900bc. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG nova.network.neutron [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port 330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:49 user nova-compute[75244]: DEBUG nova.network.neutron [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:50 user nova-compute[75244]: DEBUG nova.network.neutron [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4e4f3106-fe6c-4f80-809b-27359ea23a5f req-6a156b9f-69be-472a-9f5a-ed97112476b8 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-b6c0109c-9e43-4883-87a0-a75f03fee286. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: 15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5e62f64-14c5-4921-bc44-48c9b4096f65 req-b3b73db4-7ebf-4854-9df5-bafd42690e41 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:52 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: f3582003-456d-4661-9129-95140451254b {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:53 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port 15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Successfully updated port: 2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-f3582003-456d-4661-9129-95140451254b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-f3582003-456d-4661-9129-95140451254b. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port f3582003-456d-4661-9129-95140451254b {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-b362b04d-205d-4f80-9fe6-04d29ac24fc1. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c501e8ec-ec33-49c7-b81d-5dbd0e130120 req-515a6b00-8fec-4d65-807d-8a00b6affb21 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:02:55 user nova-compute[75244]: INFO nova.virt.block_device [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Booting with volume 5cb82e75-a465-47fd-95c3-5cbdb4d045cc at /dev/vdb
Nov 29 23:02:55 user nova-compute[75244]: DEBUG os_brick.utils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6441cd2b-bfc0-40ac-a3f2-f08535cdce85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d363c5b-077f-4120-b744-66558f62d87f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46958ea-16f8-4fe6-9007-15386d221bf8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4074ec39-9cc4-420d-9d97-39bd7244a41f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:02:55 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:02:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb6bcc-4324-41a0-9121-4778d22db3b6]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG os_brick.utils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:02:55 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating existing volume attachment record: 02cddf09-86e3-46e8-b855-eacd6d6323db {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:02:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:02:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-2b47ea01-93b6-4eca-bf6f-8898a1ce3583. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:02:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance network_info: |[{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port 2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updated VIF entry in instance network info cache for port 2b47ea01-93b6-4eca-bf6f-8898a1ce3583. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:02:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-638c98cb-2ed5-41ec-a3ce-dab5c99c6f48 req-0f1bdd5c-b7c7-449e-9d83-d7feb977e5dc service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:02:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:02:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:03 user nova-compute[75244]: INFO nova.virt.block_device [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Booting with volume e45ab9e7-7789-4395-a56f-4314bde0a903 at /dev/vdc
Nov 29 23:03:04 user nova-compute[75244]: DEBUG os_brick.utils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5816f8-885f-43f5-8a83-e1a18017d3a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fa70ae-375b-4aee-b0c9-7dadf3d6ed22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6acdc58-8003-4348-8b41-a718594156c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ad874-4680-4ecb-9f2a-8f0b34d0ef86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:04 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:03:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf38d3-e84a-4385-b31d-e9e5f692c7a3]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG os_brick.utils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating existing volume attachment record: f20da365-2fc5-486a-a768-5a4e872fe37d {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:03:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:03:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:03:06 user nova-compute[75244]: INFO nova.compute.claims [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Claim successful on node user
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:03:07 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.policy [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34cc981cad504120ac7e4507e9c08fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555c96d9ec5c48fe814663a5cdd84ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:03:07 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Creating image(s)
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "73d62816dfbaea01a73a1284fdd5d087e424c691" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "73d62816dfbaea01a73a1284fdd5d087e424c691" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Successfully created port: c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.virt.images [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] 8535e5de-ca54-45f0-8b70-966754936146 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.part /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.part /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.converted" returned: 0 in 0.229s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "73d62816dfbaea01a73a1284fdd5d087e424c691" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.040s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Successfully updated port: c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing instance network info cache due to event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json" returned: 0 in 0.230s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "73d62816dfbaea01a73a1284fdd5d087e424c691" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "73d62816dfbaea01a73a1284fdd5d087e424c691" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691,backing_fmt=raw /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691,backing_fmt=raw /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk 1073741824" returned: 0 in 0.046s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "73d62816dfbaea01a73a1284fdd5d087e424c691" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance network_info: |[{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.neutron [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Cannot resize image /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Ensure instance console log exists: /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Start _get_guest_xml network_info=[{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T23:03:04Z,direct_url=<?>,disk_format='qcow2',id=8535e5de-ca54-45f0-8b70-966754936146,min_disk=0,min_ram=0,name='tempest-scenario-img--1697914684',owner='555c96d9ec5c48fe814663a5cdd84ffa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T23:03:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': '8535e5de-ca54-45f0-8b70-966754936146'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:03:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.neutron [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updated VIF entry in instance network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.neutron [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T23:03:04Z,direct_url=<?>,disk_format='qcow2',id=8535e5de-ca54-45f0-8b70-966754936146,min_disk=0,min_ram=0,name='tempest-scenario-img--1697914684',owner='555c96d9ec5c48fe814663a5cdd84ffa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T23:03:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-396357613',display_name='tempest-TestMinimumBasicScenario-server-396357613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-396357613',id=11,image_ref='8535e5de-ca54-45f0-8b70-966754936146',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLScX4pqdrRr1ln97nLX+ALZdsjG8lNthiDFSqMku/DFwNFXN8t5ry3Zzu087GXOadHq194avwX07szSnPVyAiIQ/72vKRThTMo1Hwn9OSVqr5I+IPcKXokLXWn8ra0klA==',key_name='tempest-TestMinimumBasicScenario-1615951852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-br2k38jo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8535e5de-ca54-45f0-8b70-966754936146',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:03:07Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=f54c0598-0bc1-40c2-ae18-db0bc62f3039,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'pci_devices' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-073bd5dd-ee48-4697-ae94-b572407ad039 req-69ab3794-1f06-4d62-9381-618dab838cb4 service nova] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:03:09 user nova-compute[75244]:   <uuid>f54c0598-0bc1-40c2-ae18-db0bc62f3039</uuid>
Nov 29 23:03:09 user nova-compute[75244]:   <name>instance-0000000b</name>
Nov 29 23:03:09 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:03:09 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:03:09 user nova-compute[75244]:   <metadata>
Nov 29 23:03:09 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:03:09 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:03:09 user nova-compute[75244]:       <nova:name>tempest-TestMinimumBasicScenario-server-396357613</nova:name>
Nov 29 23:03:09 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:03:09</nova:creationTime>
Nov 29 23:03:09 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:03:09 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:03:09 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:03:09 user nova-compute[75244]:       <nova:owner>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:user uuid="34cc981cad504120ac7e4507e9c08fcd">tempest-TestMinimumBasicScenario-1628079571-project-member</nova:user>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:project uuid="555c96d9ec5c48fe814663a5cdd84ffa">tempest-TestMinimumBasicScenario-1628079571</nova:project>
Nov 29 23:03:09 user nova-compute[75244]:       </nova:owner>
Nov 29 23:03:09 user nova-compute[75244]:       <nova:root type="image" uuid="8535e5de-ca54-45f0-8b70-966754936146"/>
Nov 29 23:03:09 user nova-compute[75244]:       <nova:ports>
Nov 29 23:03:09 user nova-compute[75244]:         <nova:port uuid="c93559b4-ae7f-48b3-8bb4-a3cead7495f7">
Nov 29 23:03:09 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 23:03:09 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:09 user nova-compute[75244]:       </nova:ports>
Nov 29 23:03:09 user nova-compute[75244]:     </nova:instance>
Nov 29 23:03:09 user nova-compute[75244]:   </metadata>
Nov 29 23:03:09 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:03:09 user nova-compute[75244]:     <system>
Nov 29 23:03:09 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:03:09 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:03:09 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:03:09 user nova-compute[75244]:       <entry name="serial">f54c0598-0bc1-40c2-ae18-db0bc62f3039</entry>
Nov 29 23:03:09 user nova-compute[75244]:       <entry name="uuid">f54c0598-0bc1-40c2-ae18-db0bc62f3039</entry>
Nov 29 23:03:09 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:03:09 user nova-compute[75244]:     </system>
Nov 29 23:03:09 user nova-compute[75244]:   </sysinfo>
Nov 29 23:03:09 user nova-compute[75244]:   <os>
Nov 29 23:03:09 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:03:09 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:03:09 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:03:09 user nova-compute[75244]:   </os>
Nov 29 23:03:09 user nova-compute[75244]:   <features>
Nov 29 23:03:09 user nova-compute[75244]:     <acpi/>
Nov 29 23:03:09 user nova-compute[75244]:     <apic/>
Nov 29 23:03:09 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:03:09 user nova-compute[75244]:   </features>
Nov 29 23:03:09 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:03:09 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:03:09 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:03:09 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:03:09 user nova-compute[75244]:   </clock>
Nov 29 23:03:09 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:03:09 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:03:09 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:03:09 user nova-compute[75244]:   </cpu>
Nov 29 23:03:09 user nova-compute[75244]:   <devices>
Nov 29 23:03:09 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:03:09 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:03:09 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk"/>
Nov 29 23:03:09 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:03:09 user nova-compute[75244]:     </disk>
Nov 29 23:03:09 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:09 user nova-compute[75244]:       <mac address="fa:16:3e:ff:ff:ed"/>
Nov 29 23:03:09 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:09 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:09 user nova-compute[75244]:       <target dev="tapc93559b4-ae"/>
Nov 29 23:03:09 user nova-compute[75244]:     </interface>
Nov 29 23:03:09 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:03:09 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/console.log" append="off"/>
Nov 29 23:03:09 user nova-compute[75244]:     </serial>
Nov 29 23:03:09 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:03:09 user nova-compute[75244]:     <video>
Nov 29 23:03:09 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:09 user nova-compute[75244]:     </video>
Nov 29 23:03:09 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:03:09 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:03:09 user nova-compute[75244]:     </rng>
Nov 29 23:03:09 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:03:09 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:03:09 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:03:09 user nova-compute[75244]:     </memballoon>
Nov 29 23:03:09 user nova-compute[75244]:   </devices>
Nov 29 23:03:09 user nova-compute[75244]: </domain>
Nov 29 23:03:09 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-396357613',display_name='tempest-TestMinimumBasicScenario-server-396357613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-396357613',id=11,image_ref='8535e5de-ca54-45f0-8b70-966754936146',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLScX4pqdrRr1ln97nLX+ALZdsjG8lNthiDFSqMku/DFwNFXN8t5ry3Zzu087GXOadHq194avwX07szSnPVyAiIQ/72vKRThTMo1Hwn9OSVqr5I+IPcKXokLXWn8ra0klA==',key_name='tempest-TestMinimumBasicScenario-1615951852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-br2k38jo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8535e5de-ca54-45f0-8b70-966754936146',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:03:07Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=f54c0598-0bc1-40c2-ae18-db0bc62f3039,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG os_vif [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f71a39f-6f68-5277-b7cb-a1f1f91c872b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93559b4-ae, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc93559b4-ae, col_values=(('qos', UUID('3455fc0b-b4ea-4b23-ac46-1d7bb9a8cece')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc93559b4-ae, col_values=(('external_ids', {'iface-id': 'c93559b4-ae7f-48b3-8bb4-a3cead7495f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:ff:ed', 'vm-uuid': 'f54c0598-0bc1-40c2-ae18-db0bc62f3039'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:09 user nova-compute[75244]: INFO os_vif [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae')
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No VIF found with MAC fa:16:3e:ff:ff:ed, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:03:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-dea4be3b-8a6b-4b11-9177-153557e7465c req-883a8c5c-98d9-4a92-ad48-33f52696e49a service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dea4be3b-8a6b-4b11-9177-153557e7465c req-883a8c5c-98d9-4a92-ad48-33f52696e49a service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dea4be3b-8a6b-4b11-9177-153557e7465c req-883a8c5c-98d9-4a92-ad48-33f52696e49a service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dea4be3b-8a6b-4b11-9177-153557e7465c req-883a8c5c-98d9-4a92-ad48-33f52696e49a service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-dea4be3b-8a6b-4b11-9177-153557e7465c req-883a8c5c-98d9-4a92-ad48-33f52696e49a service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:11 user nova-compute[75244]: WARNING nova.compute.manager [req-dea4be3b-8a6b-4b11-9177-153557e7465c req-883a8c5c-98d9-4a92-ad48-33f52696e49a service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state building and task_state spawning.
Nov 29 23:03:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:03:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Creating image(s)
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Ensure instance console log exists: /opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Start _get_guest_xml network_info=[{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeDCAopS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8b888b3-9f53-4681-b46a-73b04625edd3', 'attached_at': '', 'detached_at': '', 'volume_id': '1adbe548-5aaf-4aff-96b5-d3b1d733a62c', 'serial': '1adbe548-5aaf-4aff-96b5-d3b1d733a62c'}, 'attachment_id': '23a59328-a2da-48cc-afac-b451b79f9bd2', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqBEhMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8b888b3-9f53-4681-b46a-73b04625edd3', 'attached_at': '', 'detached_at': '', 'volume_id': '5cb82e75-a465-47fd-95c3-5cbdb4d045cc', 'serial': '5cb82e75-a465-47fd-95c3-5cbdb4d045cc'}, 'attachment_id': '02cddf09-86e3-46e8-b855-eacd6d6323db', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znosCRtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8b888b3-9f53-4681-b46a-73b04625edd3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e45ab9e7-7789-4395-a56f-4314bde0a903', 'serial': 'e45ab9e7-7789-4395-a56f-4314bde0a903'}, 'attachment_id': 'f20da365-2fc5-486a-a768-5a4e872fe37d', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:03:12 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:12 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connector [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Factory for ISCSI on None {{(pid=75244) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeDCAopS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:12 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[63749b4a-14dc-4bb2-8341-5436d2132b26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:03:12 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ade6f1-f911-4934-983a-3302e000f451]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c] added
Nov 29 23:03:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.081s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01db351-522d-4ec3-9289-ac2368c76203]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda9d19-5f1f-408a-bc87-acb6ed24e2f3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeDCAopS {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeDCAopS" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d66ed2-b78f-4de2-95b7-bcc6c887306b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xeDCAopS'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea4c092-42d5-410d-90c5-46fe2b64e983]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153279b-56b3-45c9-93d1-327ac45802f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:03:12 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:03:12 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:03:12 user nova-compute[75244]: 
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab551233-e788-4d99-9f8c-414a0843e1a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260]
Nov 29 23:03:12 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260] successful.
Nov 29 23:03:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13f72c-bdb6-419a-ab18-09d64f717913]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75bd363-0331-4a25-b479-20e730d66df8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e865bc5-97f7-4fa2-a71b-c1e3aacf16e2]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeDCAopS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:03:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance spawned successfully.
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:13 user nova-compute[75244]: INFO nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 29 23:03:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-3e4ac5f0-bbf7-4723-8e0e-b81a50c90b04 req-34df6705-cbe5-4db2-a7b8-7dd6f895dff3 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3e4ac5f0-bbf7-4723-8e0e-b81a50c90b04 req-34df6705-cbe5-4db2-a7b8-7dd6f895dff3 service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3e4ac5f0-bbf7-4723-8e0e-b81a50c90b04 req-34df6705-cbe5-4db2-a7b8-7dd6f895dff3 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3e4ac5f0-bbf7-4723-8e0e-b81a50c90b04 req-34df6705-cbe5-4db2-a7b8-7dd6f895dff3 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-3e4ac5f0-bbf7-4723-8e0e-b81a50c90b04 req-34df6705-cbe5-4db2-a7b8-7dd6f895dff3 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:13 user nova-compute[75244]: WARNING nova.compute.manager [req-3e4ac5f0-bbf7-4723-8e0e-b81a50c90b04 req-34df6705-cbe5-4db2-a7b8-7dd6f895dff3 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state building and task_state spawning.
Nov 29 23:03:13 user nova-compute[75244]: INFO nova.compute.manager [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Took 6.47 seconds to build instance.
Nov 29 23:03:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-52cff877-80e2-4981-b0e1-52139c1f6807 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23861306666653235', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861306666653235', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqBEhMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:13 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:03:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e01cfb-edae-4e8d-8a61-7b24b8aa1874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:03:14 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[587bc110-252d-44f0-af6a-2b8252319981]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc] added
Nov 29 23:03:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1460ccbe-36a0-4c44-814a-d9ffd176a9d0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffd5eda-107f-441a-acf9-c043412dd56c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqBEhMTJ {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqBEhMTJ" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[15796d9a-9852-43a7-a70c-005f4d693fba]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uqBEhMTJ'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[877a4b36-af20-4f65-95c2-bff8345456cc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0915a944-e694-47b9-97b7-869a67d7529c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[249933a3-a543-4930-9d4e-4b12a5bcb3b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260]
Nov 29 23:03:14 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260] successful.
Nov 29 23:03:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc22141-51d2-4387-8291-0fb75dc8c70e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa06dc-a35b-4024-9beb-5f0727002294]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:14 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:14 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e93813-b047-4546-bef9-60113bd39385]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqBEhMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26165303130393830', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165303130393830', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znosCRtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:15 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:15 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:15 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad6779-a365-4f19-b464-41b4485d0cf8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:03:15 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee486af9-1694-4a60-aade-0d7d1adebca8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903] added
Nov 29 23:03:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb8ee2-2f3f-4961-a81f-f051193faafd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3e52a-79a7-45cb-89a0-446434ed98f8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znosCRtw {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znosCRtw" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985ad53-f40a-42df-a7fb-0f5a65fec5f6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'znosCRtw'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e16420-801e-4e79-b0ad-f011fd6d29e1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66eccc7-dfd3-438f-ab3e-4555ba5f7c00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc125b5-149e-4e9c-81d3-c0f7a88921e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260]
Nov 29 23:03:15 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260] successful.
Nov 29 23:03:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[276928bf-05ac-4ce6-80d6-5133375467d0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6066b2-5d1f-473e-9fde-608e062114d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:15 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:15 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f6863-baab-4fa8-9323-2107fb191aef]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:03:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znosCRtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23738396134393231', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738396134393231', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lazy-loading 'pci_devices' on Instance uuid c8b888b3-9f53-4681-b46a-73b04625edd3 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:03:16 user nova-compute[75244]:   <uuid>c8b888b3-9f53-4681-b46a-73b04625edd3</uuid>
Nov 29 23:03:16 user nova-compute[75244]:   <name>instance-0000000a</name>
Nov 29 23:03:16 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:03:16 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:03:16 user nova-compute[75244]:   <metadata>
Nov 29 23:03:16 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:03:16 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:03:16 user nova-compute[75244]:       <nova:name>tempest-device-tagging-server-355562227</nova:name>
Nov 29 23:03:16 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:03:12</nova:creationTime>
Nov 29 23:03:16 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:03:16 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:03:16 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:03:16 user nova-compute[75244]:       <nova:owner>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:user uuid="d5a33c7b60c142e3bd7ab47024678e62">tempest-TaggedBootDevicesTest_v242-1071915267-project-member</nova:user>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:project uuid="7769278e5e9f4143aa262b52dce8e991">tempest-TaggedBootDevicesTest_v242-1071915267</nova:project>
Nov 29 23:03:16 user nova-compute[75244]:       </nova:owner>
Nov 29 23:03:16 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:03:16 user nova-compute[75244]:       <nova:ports>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="330c9b41-e54a-463e-afa8-d021a11900bc">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="fa1fc9cb-1778-4f37-9a12-3a91d8b9302f">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.92" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="b6c0109c-9e43-4883-87a0-a75f03fee286">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="15f316a0-c3f3-48f8-b8d4-2e025b8e11f2">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="f3582003-456d-4661-9129-95140451254b">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="b362b04d-205d-4f80-9fe6-04d29ac24fc1">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:         <nova:port uuid="2b47ea01-93b6-4eca-bf6f-8898a1ce3583">
Nov 29 23:03:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 23:03:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:16 user nova-compute[75244]:       </nova:ports>
Nov 29 23:03:16 user nova-compute[75244]:     </nova:instance>
Nov 29 23:03:16 user nova-compute[75244]:   </metadata>
Nov 29 23:03:16 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:03:16 user nova-compute[75244]:     <system>
Nov 29 23:03:16 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:03:16 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:03:16 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:03:16 user nova-compute[75244]:       <entry name="serial">c8b888b3-9f53-4681-b46a-73b04625edd3</entry>
Nov 29 23:03:16 user nova-compute[75244]:       <entry name="uuid">c8b888b3-9f53-4681-b46a-73b04625edd3</entry>
Nov 29 23:03:16 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:03:16 user nova-compute[75244]:     </system>
Nov 29 23:03:16 user nova-compute[75244]:   </sysinfo>
Nov 29 23:03:16 user nova-compute[75244]:   <os>
Nov 29 23:03:16 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:03:16 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:03:16 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:03:16 user nova-compute[75244]:   </os>
Nov 29 23:03:16 user nova-compute[75244]:   <features>
Nov 29 23:03:16 user nova-compute[75244]:     <acpi/>
Nov 29 23:03:16 user nova-compute[75244]:     <apic/>
Nov 29 23:03:16 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:03:16 user nova-compute[75244]:   </features>
Nov 29 23:03:16 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:03:16 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:03:16 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:03:16 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:03:16 user nova-compute[75244]:   </clock>
Nov 29 23:03:16 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:03:16 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:03:16 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:03:16 user nova-compute[75244]:   </cpu>
Nov 29 23:03:16 user nova-compute[75244]:   <devices>
Nov 29 23:03:16 user nova-compute[75244]:     <disk type="file" device="cdrom">
Nov 29 23:03:16 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 23:03:16 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3/disk.config"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="hda" bus="ide"/>
Nov 29 23:03:16 user nova-compute[75244]:     </disk>
Nov 29 23:03:16 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:03:16 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:03:16 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <serial>1adbe548-5aaf-4aff-96b5-d3b1d733a62c</serial>
Nov 29 23:03:16 user nova-compute[75244]:     </disk>
Nov 29 23:03:16 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:03:16 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:03:16 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <serial>5cb82e75-a465-47fd-95c3-5cbdb4d045cc</serial>
Nov 29 23:03:16 user nova-compute[75244]:     </disk>
Nov 29 23:03:16 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:03:16 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:03:16 user nova-compute[75244]:       <source dev="/dev/sdd"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="vdc" bus="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <serial>e45ab9e7-7789-4395-a56f-4314bde0a903</serial>
Nov 29 23:03:16 user nova-compute[75244]:     </disk>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:41:6a:a3"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tap330c9b41-e5"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:ab:1c:c5"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tapfa1fc9cb-17"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:dd:24:49"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tapb6c0109c-9e"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:73:62:f5"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tap15f316a0-c3"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:32:46:97"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tapf3582003-45"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:5c:20:da"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tapb362b04d-20"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:16 user nova-compute[75244]:       <mac address="fa:16:3e:d7:32:bf"/>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:16 user nova-compute[75244]:       <target dev="tap2b47ea01-93"/>
Nov 29 23:03:16 user nova-compute[75244]:     </interface>
Nov 29 23:03:16 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:03:16 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3/console.log" append="off"/>
Nov 29 23:03:16 user nova-compute[75244]:     </serial>
Nov 29 23:03:16 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:03:16 user nova-compute[75244]:     <video>
Nov 29 23:03:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:16 user nova-compute[75244]:     </video>
Nov 29 23:03:16 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:03:16 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:03:16 user nova-compute[75244]:     </rng>
Nov 29 23:03:16 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:03:16 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:03:16 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:03:16 user nova-compute[75244]:     </memballoon>
Nov 29 23:03:16 user nova-compute[75244]:   </devices>
Nov 29 23:03:16 user nova-compute[75244]: </domain>
Nov 29 23:03:16 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7162609d-e55f-564a-8960-45f5c593c6b4', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap330c9b41-e5, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap330c9b41-e5, col_values=(('qos', UUID('b8ecae5d-5b24-4bf0-9290-fa3cde6eb17f')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap330c9b41-e5, col_values=(('external_ids', {'iface-id': '330c9b41-e54a-463e-afa8-d021a11900bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:6a:a3', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5')
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70f82fb6-3430-5ddb-ad16-f94054df3545', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa1fc9cb-17, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa1fc9cb-17, col_values=(('qos', UUID('d740de56-9ecb-4f2c-836e-ad804a5854b3')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa1fc9cb-17, col_values=(('external_ids', {'iface-id': 'fa1fc9cb-1778-4f37-9a12-3a91d8b9302f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:1c:c5', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17')
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d4d2a59-256f-5adc-b27c-cb99324c915e', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6c0109c-9e, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6c0109c-9e, col_values=(('qos', UUID('7570d18d-9338-4294-a05b-40289d3b73ca')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6c0109c-9e, col_values=(('external_ids', {'iface-id': 'b6c0109c-9e43-4883-87a0-a75f03fee286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:24:49', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e')
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '144e913e-c459-58ce-bcaa-ee97b6cca6c8', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15f316a0-c3, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15f316a0-c3, col_values=(('qos', UUID('2d451df9-353f-4bfe-97ac-fb61312ae1b3')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15f316a0-c3, col_values=(('external_ids', {'iface-id': '15f316a0-c3f3-48f8-b8d4-2e025b8e11f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:62:f5', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3')
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79bdbeb7-ef36-579f-ae1a-ebda845c4c53', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3582003-45, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3582003-45, col_values=(('qos', UUID('389ee14d-7b35-4483-abac-906a3193e470')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3582003-45, col_values=(('external_ids', {'iface-id': 'f3582003-456d-4661-9129-95140451254b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:46:97', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45')
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de895dc1-b662-5255-aa32-2449d0d3283e', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb362b04d-20, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb362b04d-20, col_values=(('qos', UUID('3b3b9951-2b8d-4346-b3db-ddfc76a1b15f')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb362b04d-20, col_values=(('external_ids', {'iface-id': 'b362b04d-205d-4f80-9fe6-04d29ac24fc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:20:da', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20')
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfa1b828-3726-5386-8357-af4a2041ca0b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b47ea01-93, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b47ea01-93, col_values=(('qos', UUID('9556c3e2-985c-4f93-961a-a27aabb6b0b1')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b47ea01-93, col_values=(('external_ids', {'iface-id': '2b47ea01-93b6-4eca-bf6f-8898a1ce3583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:32:bf', 'vm-uuid': 'c8b888b3-9f53-4681-b46a-73b04625edd3'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:17 user nova-compute[75244]: INFO os_vif [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93')
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] No BDM found with device name hda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] No VIF found with MAC fa:16:3e:41:6a:a3, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] No VIF found with MAC fa:16:3e:32:46:97, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:03:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Using config drive
Nov 29 23:03:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Creating config drive at /opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3/disk.config
Nov 29 23:03:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwmlgl5mj {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwmlgl5mj" returned: 0 in 0.056s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-1d7ed772-b4ca-4730-92e5-1242a67bef92 req-41b6be29-76bb-4c5e-9a60-472d8007f356 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d7ed772-b4ca-4730-92e5-1242a67bef92 req-41b6be29-76bb-4c5e-9a60-472d8007f356 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d7ed772-b4ca-4730-92e5-1242a67bef92 req-41b6be29-76bb-4c5e-9a60-472d8007f356 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d7ed772-b4ca-4730-92e5-1242a67bef92 req-41b6be29-76bb-4c5e-9a60-472d8007f356 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-1d7ed772-b4ca-4730-92e5-1242a67bef92 req-41b6be29-76bb-4c5e-9a60-472d8007f356 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:19 user nova-compute[75244]: WARNING nova.compute.manager [req-1d7ed772-b4ca-4730-92e5-1242a67bef92 req-41b6be29-76bb-4c5e-9a60-472d8007f356 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc for instance with vm_state building and task_state spawning.
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-bcf34944-8e73-463a-b534-476b2fd565e8 req-87ccca71-8625-443d-9634-8e09bf15f905 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bcf34944-8e73-463a-b534-476b2fd565e8 req-87ccca71-8625-443d-9634-8e09bf15f905 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bcf34944-8e73-463a-b534-476b2fd565e8 req-87ccca71-8625-443d-9634-8e09bf15f905 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bcf34944-8e73-463a-b534-476b2fd565e8 req-87ccca71-8625-443d-9634-8e09bf15f905 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-bcf34944-8e73-463a-b534-476b2fd565e8 req-87ccca71-8625-443d-9634-8e09bf15f905 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:20 user nova-compute[75244]: WARNING nova.compute.manager [req-bcf34944-8e73-463a-b534-476b2fd565e8 req-87ccca71-8625-443d-9634-8e09bf15f905 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 for instance with vm_state building and task_state spawning.
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-f3582003-456d-4661-9129-95140451254b for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-f3582003-456d-4661-9129-95140451254b for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:21 user nova-compute[75244]: WARNING nova.compute.manager [req-f4260d97-1a6f-456a-90d2-f7b50903f525 req-89d588d5-dc1c-4602-83f8-a1fb7e3da0c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 for instance with vm_state building and task_state spawning.
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-d8c33101-985f-4082-af0a-ddb5b7e73918 req-3a55f96d-9976-43dc-978c-de4b95b5c1e2 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d8c33101-985f-4082-af0a-ddb5b7e73918 req-3a55f96d-9976-43dc-978c-de4b95b5c1e2 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d8c33101-985f-4082-af0a-ddb5b7e73918 req-3a55f96d-9976-43dc-978c-de4b95b5c1e2 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d8c33101-985f-4082-af0a-ddb5b7e73918 req-3a55f96d-9976-43dc-978c-de4b95b5c1e2 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-d8c33101-985f-4082-af0a-ddb5b7e73918 req-3a55f96d-9976-43dc-978c-de4b95b5c1e2 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:22 user nova-compute[75244]: WARNING nova.compute.manager [req-d8c33101-985f-4082-af0a-ddb5b7e73918 req-3a55f96d-9976-43dc-978c-de4b95b5c1e2 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 for instance with vm_state building and task_state spawning.
Nov 29 23:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:23 user nova-compute[75244]: WARNING nova.compute.manager [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 for instance with vm_state building and task_state spawning.
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:23 user nova-compute[75244]: WARNING nova.compute.manager [req-dc833977-21d4-44f1-850d-d9cb297fb6de req-924f40f1-a2c0-48e0-8812-eca641ba823e service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 for instance with vm_state building and task_state spawning.
Nov 29 23:03:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance spawned successfully.
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:23 user nova-compute[75244]: INFO nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Took 11.36 seconds to spawn the instance on the hypervisor.
Nov 29 23:03:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:23 user nova-compute[75244]: INFO nova.compute.manager [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Took 39.71 seconds to build instance.
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e665ebe8-a76c-4ac5-b8a9-06aaa50fb647 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.818s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG nova.objects.instance [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lazy-loading 'flavor' on Instance uuid 794fea73-9d39-499d-8904-7c916a669709 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:24 user nova-compute[75244]: INFO nova.compute.manager [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Attaching volume 26aa9ec4-09cf-4104-a011-cae9a24a35e6 to /dev/vdb
Nov 29 23:03:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG os_brick.utils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c55a5-ae60-4397-a669-bd573a33be7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d563139-f889-435c-a16a-f70dc4993229]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82077b6a-3465-4574-a0e9-e26f02e51554]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc407a40-c69c-4be2-bc3b-152a07f7e4bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:25 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:03:25 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd6fdb-48e9-47f1-b553-9b0aaea0b1d6]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG os_brick.utils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:25 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updating existing volume attachment record: 2fcede5b-3843-47d2-8caa-f65ce297f499 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:03:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "254dca38-2e6d-4303-86af-369275d7529f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:03:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:03:26 user nova-compute[75244]: INFO nova.compute.claims [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Claim successful on node user
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:03:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.policy [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f680496b0c147a48948cb1f24c65797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15889b42830c48049aa8537bd8e82d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:03:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Creating image(s)
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "/opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "/opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "/opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk 1073741824" returned: 0 in 0.056s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.259s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Successfully created port: bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Cannot resize image /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Ensure instance console log exists: /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Successfully updated port: bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "refresh_cache-254dca38-2e6d-4303-86af-369275d7529f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquired lock "refresh_cache-254dca38-2e6d-4303-86af-369275d7529f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-changed-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Refreshing instance network info cache due to event network-changed-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] Acquiring lock "refresh_cache-254dca38-2e6d-4303-86af-369275d7529f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Updating instance_info_cache with network_info: [{"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Releasing lock "refresh_cache-254dca38-2e6d-4303-86af-369275d7529f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Instance network_info: |[{"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] Acquired lock "refresh_cache-254dca38-2e6d-4303-86af-369275d7529f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Refreshing network info cache for port bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Start _get_guest_xml network_info=[{"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:03:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-293305103',display_name='tempest-ServersNegativeTestJSON-server-293305103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-293305103',id=12,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15889b42830c48049aa8537bd8e82d56',ramdisk_id='',reservation_id='r-u0o460uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1248877561',owner_user_name='tempest-ServersNegativeTestJSON-1248877561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:03:28Z,user_data=None,user_id='7f680496b0c147a48948cb1f24c65797',uuid=254dca38-2e6d-4303-86af-369275d7529f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converting VIF {"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.objects.instance [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lazy-loading 'pci_devices' on Instance uuid 254dca38-2e6d-4303-86af-369275d7529f {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:03:29 user nova-compute[75244]:   <uuid>254dca38-2e6d-4303-86af-369275d7529f</uuid>
Nov 29 23:03:29 user nova-compute[75244]:   <name>instance-0000000c</name>
Nov 29 23:03:29 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:03:29 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:03:29 user nova-compute[75244]:   <metadata>
Nov 29 23:03:29 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:03:29 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:03:29 user nova-compute[75244]:       <nova:name>tempest-ServersNegativeTestJSON-server-293305103</nova:name>
Nov 29 23:03:29 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:03:29</nova:creationTime>
Nov 29 23:03:29 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:03:29 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:03:29 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:03:29 user nova-compute[75244]:       <nova:owner>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:user uuid="7f680496b0c147a48948cb1f24c65797">tempest-ServersNegativeTestJSON-1248877561-project-member</nova:user>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:project uuid="15889b42830c48049aa8537bd8e82d56">tempest-ServersNegativeTestJSON-1248877561</nova:project>
Nov 29 23:03:29 user nova-compute[75244]:       </nova:owner>
Nov 29 23:03:29 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:03:29 user nova-compute[75244]:       <nova:ports>
Nov 29 23:03:29 user nova-compute[75244]:         <nova:port uuid="bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7">
Nov 29 23:03:29 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:03:29 user nova-compute[75244]:         </nova:port>
Nov 29 23:03:29 user nova-compute[75244]:       </nova:ports>
Nov 29 23:03:29 user nova-compute[75244]:     </nova:instance>
Nov 29 23:03:29 user nova-compute[75244]:   </metadata>
Nov 29 23:03:29 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:03:29 user nova-compute[75244]:     <system>
Nov 29 23:03:29 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:03:29 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:03:29 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:03:29 user nova-compute[75244]:       <entry name="serial">254dca38-2e6d-4303-86af-369275d7529f</entry>
Nov 29 23:03:29 user nova-compute[75244]:       <entry name="uuid">254dca38-2e6d-4303-86af-369275d7529f</entry>
Nov 29 23:03:29 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:03:29 user nova-compute[75244]:     </system>
Nov 29 23:03:29 user nova-compute[75244]:   </sysinfo>
Nov 29 23:03:29 user nova-compute[75244]:   <os>
Nov 29 23:03:29 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:03:29 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:03:29 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:03:29 user nova-compute[75244]:   </os>
Nov 29 23:03:29 user nova-compute[75244]:   <features>
Nov 29 23:03:29 user nova-compute[75244]:     <acpi/>
Nov 29 23:03:29 user nova-compute[75244]:     <apic/>
Nov 29 23:03:29 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:03:29 user nova-compute[75244]:   </features>
Nov 29 23:03:29 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:03:29 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:03:29 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:03:29 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:03:29 user nova-compute[75244]:   </clock>
Nov 29 23:03:29 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:03:29 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:03:29 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:03:29 user nova-compute[75244]:   </cpu>
Nov 29 23:03:29 user nova-compute[75244]:   <devices>
Nov 29 23:03:29 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:03:29 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:03:29 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk"/>
Nov 29 23:03:29 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:03:29 user nova-compute[75244]:     </disk>
Nov 29 23:03:29 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:03:29 user nova-compute[75244]:       <mac address="fa:16:3e:43:60:b3"/>
Nov 29 23:03:29 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:29 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:03:29 user nova-compute[75244]:       <target dev="tapbcfc38e7-ba"/>
Nov 29 23:03:29 user nova-compute[75244]:     </interface>
Nov 29 23:03:29 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:03:29 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/console.log" append="off"/>
Nov 29 23:03:29 user nova-compute[75244]:     </serial>
Nov 29 23:03:29 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:03:29 user nova-compute[75244]:     <video>
Nov 29 23:03:29 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:03:29 user nova-compute[75244]:     </video>
Nov 29 23:03:29 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:03:29 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:03:29 user nova-compute[75244]:     </rng>
Nov 29 23:03:29 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:03:29 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:03:29 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:03:29 user nova-compute[75244]:     </memballoon>
Nov 29 23:03:29 user nova-compute[75244]:   </devices>
Nov 29 23:03:29 user nova-compute[75244]: </domain>
Nov 29 23:03:29 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-293305103',display_name='tempest-ServersNegativeTestJSON-server-293305103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-293305103',id=12,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15889b42830c48049aa8537bd8e82d56',ramdisk_id='',reservation_id='r-u0o460uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1248877561',owner_user_name='tempest-ServersNegativeTestJSON-1248877561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:03:28Z,user_data=None,user_id='7f680496b0c147a48948cb1f24c65797',uuid=254dca38-2e6d-4303-86af-369275d7529f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converting VIF {"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG os_vif [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa629bbc-9085-5078-a20d-df69e7dfaa1e', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcfc38e7-ba, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcfc38e7-ba, col_values=(('qos', UUID('63056bc5-cf77-4dbb-901e-7d3fa053b0e3')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcfc38e7-ba, col_values=(('external_ids', {'iface-id': 'bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:60:b3', 'vm-uuid': '254dca38-2e6d-4303-86af-369275d7529f'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: INFO os_vif [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba')
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] No VIF found with MAC fa:16:3e:43:60:b3, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Updated VIF entry in instance network info cache for port bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:03:29 user nova-compute[75244]: DEBUG nova.network.neutron [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Updating instance_info_cache with network_info: [{"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08d34942-1d1c-47e2-bb53-32a4493bff01 req-e4d0ae5b-8a22-456d-85c0-6b37a54342d1 service nova] Releasing lock "refresh_cache-254dca38-2e6d-4303-86af-369275d7529f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-caae9686-ce7c-46d2-898d-a91e5ccfabe3 req-3cecc8a9-c53e-4d09-bc45-9a7120c7df25 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-caae9686-ce7c-46d2-898d-a91e5ccfabe3 req-3cecc8a9-c53e-4d09-bc45-9a7120c7df25 service nova] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-caae9686-ce7c-46d2-898d-a91e5ccfabe3 req-3cecc8a9-c53e-4d09-bc45-9a7120c7df25 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-caae9686-ce7c-46d2-898d-a91e5ccfabe3 req-3cecc8a9-c53e-4d09-bc45-9a7120c7df25 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-caae9686-ce7c-46d2-898d-a91e5ccfabe3 req-3cecc8a9-c53e-4d09-bc45-9a7120c7df25 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] No waiting events found dispatching network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:31 user nova-compute[75244]: WARNING nova.compute.manager [req-caae9686-ce7c-46d2-898d-a91e5ccfabe3 req-3cecc8a9-c53e-4d09-bc45-9a7120c7df25 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received unexpected event network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 for instance with vm_state building and task_state spawning.
Nov 29 23:03:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-8fd34a48-7388-4192-bbfe-b433803fcc02 req-65de2ea0-bd19-4907-b2d0-4c92589c8bb5 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8fd34a48-7388-4192-bbfe-b433803fcc02 req-65de2ea0-bd19-4907-b2d0-4c92589c8bb5 service nova] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8fd34a48-7388-4192-bbfe-b433803fcc02 req-65de2ea0-bd19-4907-b2d0-4c92589c8bb5 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8fd34a48-7388-4192-bbfe-b433803fcc02 req-65de2ea0-bd19-4907-b2d0-4c92589c8bb5 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-8fd34a48-7388-4192-bbfe-b433803fcc02 req-65de2ea0-bd19-4907-b2d0-4c92589c8bb5 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] No waiting events found dispatching network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:33 user nova-compute[75244]: WARNING nova.compute.manager [req-8fd34a48-7388-4192-bbfe-b433803fcc02 req-65de2ea0-bd19-4907-b2d0-4c92589c8bb5 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received unexpected event network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 for instance with vm_state building and task_state spawning.
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:03:33 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Instance spawned successfully.
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:03:34 user nova-compute[75244]: INFO nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: INFO nova.compute.manager [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Took 7.71 seconds to build instance.
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xabpcWmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:34 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:34 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:34 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:34 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7079MB free_disk=25.36724090576172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e27dc92-bfa6-410d-a0c7-af8010e2b108 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "254dca38-2e6d-4303-86af-369275d7529f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.822s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7242ed-0bdd-48ac-a323-a25425c7a761]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:03:34 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb01bc-8944-4158-ad09-c4e94b4c28b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6] added
Nov 29 23:03:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1ed58c-a8a9-4c06-98a3-09b2b7619243]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9605777-76cd-480d-b784-bb19dc665394]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xabpcWmz {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xabpcWmz" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9967d80-480e-48bd-9586-aa8f289bdde4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xabpcWmz'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 794fea73-9d39-499d-8904-7c916a669709 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f2b866e9-d721-494e-b4ce-9605047d87de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 52205529-6ed5-42f2-b29d-88d4f4b1718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance c8b888b3-9f53-4681-b46a-73b04625edd3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 254dca38-2e6d-4303-86af-369275d7529f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8e6e1f-8dde-4943-8704-4c723cf70638]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8bd99-5b12-4820-9fa4-7394e30a6e03]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567b6ba-3410-4630-9d0e-b3f7705c267d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260]
Nov 29 23:03:34 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260] successful.
Nov 29 23:03:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8f8b5d-2a6e-4bc8-90a9-9f07396cecaf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a3ebe-67e7-4799-9b79-6a7265169ebb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 (non-flash)
Nov 29 23:03:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:34 user nova-compute[75244]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 (non-flash)
Nov 29 23:03:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e69f9-fdcf-44ed-82fa-d81ed826da3b]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xabpcWmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23365316439366234', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365316439366234', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:03:35 user nova-compute[75244]: DEBUG nova.objects.instance [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lazy-loading 'flavor' on Instance uuid 794fea73-9d39-499d-8904-7c916a669709 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:03:36 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:03:36 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:03:36 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:03:36 user nova-compute[75244]:   <serial>26aa9ec4-09cf-4104-a011-cae9a24a35e6</serial>
Nov 29 23:03:36 user nova-compute[75244]: </disk>
Nov 29 23:03:36 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] No VIF found with MAC fa:16:3e:49:f2:a1, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89d7aaec-ad6e-4ad1-addb-7af512b2928b tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.820s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updating instance_info_cache with network_info: [{"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:37 user nova-compute[75244]: INFO nova.compute.manager [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Terminating instance
Nov 29 23:03:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f6a4b0a-31e5-479c-a540-a9fa125c4253 req-1d040a74-369c-481a-b72e-47f6a1cb680f service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-vif-unplugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f6a4b0a-31e5-479c-a540-a9fa125c4253 req-1d040a74-369c-481a-b72e-47f6a1cb680f service nova] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f6a4b0a-31e5-479c-a540-a9fa125c4253 req-1d040a74-369c-481a-b72e-47f6a1cb680f service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f6a4b0a-31e5-479c-a540-a9fa125c4253 req-1d040a74-369c-481a-b72e-47f6a1cb680f service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f6a4b0a-31e5-479c-a540-a9fa125c4253 req-1d040a74-369c-481a-b72e-47f6a1cb680f service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] No waiting events found dispatching network-vif-unplugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f6a4b0a-31e5-479c-a540-a9fa125c4253 req-1d040a74-369c-481a-b72e-47f6a1cb680f service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-vif-unplugged-470fec0d-9ed4-4231-83d8-e99d177bc04c for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:03:37 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 794fea73-9d39-499d-8904-7c916a669709] Instance destroyed successfully.
Nov 29 23:03:37 user nova-compute[75244]: DEBUG nova.objects.instance [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lazy-loading 'resources' on Instance uuid 794fea73-9d39-499d-8904-7c916a669709 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1640220047',display_name='tempest-DeleteServersTestJSON-server-1640220047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1640220047',id=1,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b30da76f04446f699625b28e337ed09',ramdisk_id='',reservation_id='r-3kahwhts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-972125243',owner_user_name='tempest-DeleteServersTestJSON-972125243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:01:47Z,user_data=None,user_id='48e5bb05edc6476fb506bd68034d83d8',uuid=794fea73-9d39-499d-8904-7c916a669709,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Converting VIF {"id": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "address": "fa:16:3e:49:f2:a1", "network": {"id": "fb3ee424-a7e5-4a55-aa22-ae515c3b0051", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1419258035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b30da76f04446f699625b28e337ed09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470fec0d-9e", "ovs_interfaceid": "470fec0d-9ed4-4231-83d8-e99d177bc04c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_vif [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap470fec0d-9e, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17eb70ad-ad70-4cb6-9b13-1d181d66669c) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:03:38 user nova-compute[75244]: INFO os_vif [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:f2:a1,bridge_name='br-int',has_traffic_filtering=True,id=470fec0d-9ed4-4231-83d8-e99d177bc04c,network=Network(fb3ee424-a7e5-4a55-aa22-ae515c3b0051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470fec0d-9e')
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xabpcWmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:38 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac1a3d-f4a5-443e-9638-8b3303db5e69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:03:38 user nova-compute[75244]: No targets found.
Nov 29 23:03:38 user nova-compute[75244]: iSNS:
Nov 29 23:03:38 user nova-compute[75244]: No targets found.
Nov 29 23:03:38 user nova-compute[75244]: STATIC:
Nov 29 23:03:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:03:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:03:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:03:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6
Nov 29 23:03:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:03:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:03:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:03:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:03:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:03:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c
Nov 29 23:03:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:03:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:03:38 user nova-compute[75244]: FIRMWARE:
Nov 29 23:03:38 user nova-compute[75244]: No targets found.
Nov 29 23:03:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:03:38 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:03:38 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d776d8-1453-4080-9b0f-5d58d159ab2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3619bd-3e66-4e6b-b4c9-6882e9b0c190]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:38 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:38 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:38 user nova-compute[75244]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 (non-flash)
Nov 29 23:03:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:38 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:38 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:38 user nova-compute[75244]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 (non-flash)
Nov 29 23:03:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80472e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c00a2-0946-4cc9-a49f-d770502ed6ca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff251a09-b618-45e1-b644-8c727e1d6529]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2f937-e4b3-4f4b-9fd4-435782697f67]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-changed-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Refreshing instance network info cache due to event network-changed-69add1a4-a188-4454-9331-c39bffcd8b49. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Refreshing network info cache for port 69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f1563d-650a-431c-98c6-2892a7a74053]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fbe58-1de0-4f45-97d6-b429dc1b2f82]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82739d0-1feb-4e25-a90e-bdeedd1a0831]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260]
Nov 29 23:03:38 user nova-compute[75244]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6, portal: 172.16.0.220,3260] successful.
Nov 29 23:03:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26aa9ec4-09cf-4104-a011-cae9a24a35e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063d62b-376a-4d52-a1bf-e942d95e3ff8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] <== disconnect_volume: return (382ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:03:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Deleting instance files /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709_del
Nov 29 23:03:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Deletion of /opt/stack/data/nova/instances/794fea73-9d39-499d-8904-7c916a669709_del complete
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75244) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 23:03:38 user nova-compute[75244]: INFO nova.virt.libvirt.host [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] UEFI support detected
Nov 29 23:03:38 user nova-compute[75244]: INFO nova.compute.manager [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 794fea73-9d39-499d-8904-7c916a669709] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 794fea73-9d39-499d-8904-7c916a669709] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updated VIF entry in instance network info cache for port 69add1a4-a188-4454-9331-c39bffcd8b49. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-69f78595-d2ca-4bf4-8278-e0c91d174f40 req-118f9efd-4f40-43d6-b330-9a15cea20385 service nova] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc746540-b75e-40dc-a0f8-015bf0c68ed7 req-dd195744-b7a4-4e59-b0d3-2fac2bd4424e service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc746540-b75e-40dc-a0f8-015bf0c68ed7 req-dd195744-b7a4-4e59-b0d3-2fac2bd4424e service nova] Acquiring lock "794fea73-9d39-499d-8904-7c916a669709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc746540-b75e-40dc-a0f8-015bf0c68ed7 req-dd195744-b7a4-4e59-b0d3-2fac2bd4424e service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc746540-b75e-40dc-a0f8-015bf0c68ed7 req-dd195744-b7a4-4e59-b0d3-2fac2bd4424e service nova] Lock "794fea73-9d39-499d-8904-7c916a669709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc746540-b75e-40dc-a0f8-015bf0c68ed7 req-dd195744-b7a4-4e59-b0d3-2fac2bd4424e service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] No waiting events found dispatching network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:39 user nova-compute[75244]: WARNING nova.compute.manager [req-bc746540-b75e-40dc-a0f8-015bf0c68ed7 req-dd195744-b7a4-4e59-b0d3-2fac2bd4424e service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received unexpected event network-vif-plugged-470fec0d-9ed4-4231-83d8-e99d177bc04c for instance with vm_state active and task_state deleting.
Nov 29 23:03:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:40 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 794fea73-9d39-499d-8904-7c916a669709] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:40 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 794fea73-9d39-499d-8904-7c916a669709] Took 1.42 seconds to deallocate network for instance.
Nov 29 23:03:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-a0edd5f8-a0c5-4ab1-8e28-684574d1d9db req-d1d8b9f9-d791-4daf-a34c-7f144fa760d0 service nova] [instance: 794fea73-9d39-499d-8904-7c916a669709] Received event network-vif-deleted-470fec0d-9ed4-4231-83d8-e99d177bc04c {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:41 user nova-compute[75244]: INFO nova.compute.manager [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] [instance: 794fea73-9d39-499d-8904-7c916a669709] Took 1.15 seconds to detach 1 volumes for instance.
Nov 29 23:03:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:41 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:03:41 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:03:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:41 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Deleted allocations for instance 794fea73-9d39-499d-8904-7c916a669709
Nov 29 23:03:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing instance network info cache due to event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99e1865b-9402-437f-8a15-3d463840685a tempest-DeleteServersTestJSON-972125243 tempest-DeleteServersTestJSON-972125243-project-member] Lock "794fea73-9d39-499d-8904-7c916a669709" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.038s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updated VIF entry in instance network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:03:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e11bb808-a62f-4a8f-8140-1ca83f731f52 req-fd950569-da5d-4f00-a8f8-938483f223fd service nova] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:43 user nova-compute[75244]: INFO nova.compute.manager [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Attaching volume 5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d to /dev/vdb
Nov 29 23:03:43 user nova-compute[75244]: DEBUG os_brick.utils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d55ea-9c6a-470c-aa85-bb4ced686963]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d700dff-fe74-4e84-993f-747e3f6267c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[73baba7b-ccff-4416-bc88-279dc9349aa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d99f4bd-946f-4fb9-862e-38ba195a8726]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:43 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:03:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd888f3-e284-46f4-9c25-3d45c648b679]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG os_brick.utils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:43 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating existing volume attachment record: 9fec876c-a304-4c2f-a553-a2e25c7f2180 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:03:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:46 user nova-compute[75244]: INFO nova.compute.manager [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Shelving
Nov 29 23:03:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-57d764a7-2f7d-4437-9a02-0f292c909066 req-4e50a51b-1f22-4d83-8b56-0b0722d25278 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-57d764a7-2f7d-4437-9a02-0f292c909066 req-4e50a51b-1f22-4d83-8b56-0b0722d25278 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-57d764a7-2f7d-4437-9a02-0f292c909066 req-4e50a51b-1f22-4d83-8b56-0b0722d25278 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-57d764a7-2f7d-4437-9a02-0f292c909066 req-4e50a51b-1f22-4d83-8b56-0b0722d25278 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-57d764a7-2f7d-4437-9a02-0f292c909066 req-4e50a51b-1f22-4d83-8b56-0b0722d25278 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:46 user nova-compute[75244]: WARNING nova.compute.manager [req-57d764a7-2f7d-4437-9a02-0f292c909066 req-4e50a51b-1f22-4d83-8b56-0b0722d25278 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state shelving.
Nov 29 23:03:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:47 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance destroyed successfully.
Nov 29 23:03:47 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Beginning cold snapshot process
Nov 29 23:03:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:47 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:03:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk /opt/stack/data/nova/instances/snapshots/tmpkqku2oiq/0cce5e054d9f48b48291eacf1dfb65f1 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk /opt/stack/data/nova/instances/snapshots/tmpkqku2oiq/0cce5e054d9f48b48291eacf1dfb65f1" returned: 0 in 0.712s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:48 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Snapshot extracted, beginning image upload
Nov 29 23:03:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:48 user nova-compute[75244]: WARNING nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:48 user nova-compute[75244]: WARNING nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:48 user nova-compute[75244]: WARNING nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:48 user nova-compute[75244]: WARNING nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:03:48 user nova-compute[75244]: WARNING nova.compute.manager [req-380e28e3-5b88-454f-8e26-5ca923cf3834 req-c59353f5-6c82-4bfd-a3d2-ef01c50c3e39 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 23:03:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-changed-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Refreshing instance network info cache due to event network-changed-9c393a82-e3f5-49a4-87d6-97980abb79e9. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] Acquiring lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] Acquired lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Refreshing network info cache for port 9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:03:51 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Snapshot image upload complete
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:51 user nova-compute[75244]: INFO nova.compute.manager [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Shelve offloading
Nov 29 23:03:51 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance destroyed successfully.
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updated VIF entry in instance network info cache for port 9c393a82-e3f5-49a4-87d6-97980abb79e9. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updating instance_info_cache with network_info: [{"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-13fa5b3e-bd3c-4e4b-9687-c85a135756dd req-9caebdce-be6f-476d-a8d6-d5398583e43d service nova] Releasing lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance destroyed successfully.
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'resources' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1788131671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1788131671',id=4,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNzGqm3Tm/ItTGGk6XBWULal6mqzkFsASAJf+ylMr6CFzo4MuiO5nKzCU24l3Av5hDkOEAqi530p07uUWailDkFtu7cEIMGGmEGgD7iMA9o9SjemlX3vcHOd9I10+fkzw==',key_name='tempest-keypair-1743157863',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-oyfa3jdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member',shelved_at='2023-11-29T23:03:51.286571',shelved_host='user',shelved_image_id='46cd4d46-cfb9-4216-b016-2a6230a5b2e5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=98d0cfec-ab5d-49a0-a467-f90989f51aa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG os_vif [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8309daad-62, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccfdee93-c207-4b03-9913-870b0245222e) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:52 user nova-compute[75244]: INFO os_vif [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62')
Nov 29 23:03:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Deleting instance files /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0_del
Nov 29 23:03:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Deletion of /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0_del complete
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing instance network info cache due to event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:03:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:03:53 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Deleted allocations for instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'numa_topology' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.objects.base [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<98d0cfec-ab5d-49a0-a467-f90989f51aa0> lazy-loaded attributes: resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:03:53 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[379cd8fe-2f36-4fc7-97e8-aa439f6aa48a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:03:53 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e65e1e-409b-4581-b124-72d7a6bc03b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d] added
Nov 29 23:03:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updated VIF entry in instance network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8309daad-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3084aa6-5ba0-4de9-a355-2f075dadcca8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a07375d0-8c44-4e15-af01-41cadc2c8fed req-72f39d83-800f-4b83-8f95-a2318c842cf2 service nova] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034e01f-49f7-4557-be4e-8b08c7e6eb4f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmGolsAe {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmGolsAe" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6ff12-61b3-438b-a1a8-3d25bd35cb5b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KmGolsAe'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bc522-051c-481a-a758-58fea3a0017d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df5fe9a-dd16-4cb0-a9e1-6d02796764c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4529be55-5dff-41ce-87c1-58423999cbc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]
Nov 29 23:03:53 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.
Nov 29 23:03:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c6212-edaf-4106-821c-2e29524ca282]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9e6ecbcb-2081-4b94-89d3-c26adb9ebc60 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.286s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[75749233-078b-44e1-9585-9b45a393ceee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:03:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:03:53 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:03:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b335eca1-9c02-4fbc-a6ec-8ca1e67a3b5b]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'flavor' on Instance uuid f2b866e9-d721-494e-b4ce-9605047d87de {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:54 user nova-compute[75244]: INFO nova.compute.manager [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Attaching volume 949a2bab-1640-44d8-8aa1-7b9eab2913b6 to /dev/vdb
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.utils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddcd3f3-22d6-4e8d-ac5b-58de968c4ae9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3b7fd-d497-4d22-8069-b404ad384881]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d5ebe-b7e7-43c4-9eaa-9c228e7ba412]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d8852-7afd-4fe7-bd72-8553eaa2975a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:03:54 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:03:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c287dce3-6c17-4f4c-958c-3c4c47316d92]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.utils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updating existing volume attachment record: a9a4086b-c8a8-490e-b369-8e23342639b1 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23532376331363231', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532376331363231', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:03:54 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:03:54 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:03:54 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:03:54 user nova-compute[75244]:   <serial>5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d</serial>
Nov 29 23:03:54 user nova-compute[75244]: </disk>
Nov 29 23:03:54 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:03:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:03:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No VIF found with MAC fa:16:3e:96:27:05, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:03:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1497484b-186f-4198-a077-bcce2bccd05f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.168s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75244) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:57 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance destroyed successfully.
Nov 29 23:03:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:03:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4900185b-d1a7-49dc-a159-8707ba158cc1 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.952s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:03:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:03:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-changed-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Refreshing instance network info cache due to event network-changed-df674a1e-ea01-45a5-8867-f3ce46592f03. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] Acquiring lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] Acquired lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.network.neutron [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Refreshing network info cache for port df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-changed-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Refreshing instance network info cache due to event network-changed-2e3817c7-d46e-4da7-aecc-6ae6402a3be6. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] Acquiring lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] Acquired lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.network.neutron [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Refreshing network info cache for port 2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.network.neutron [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updated VIF entry in instance network info cache for port df674a1e-ea01-45a5-8867-f3ce46592f03. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.network.neutron [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-14730e33-cd89-405a-b2c2-5d32157d7b53 req-e39ec5f6-6632-4643-8e61-d858423f940f service nova] Releasing lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:04:00 user nova-compute[75244]: INFO nova.compute.claims [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Claim successful on node user
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "interface-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "interface-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'flavor' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'pci_requests' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.objects.base [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Object Instance<c81a4813-3b3c-4bf1-a3fe-d623aab59a1c> lazy-loaded attributes: flavor,pci_requests {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:04:00 user nova-compute[75244]: DEBUG nova.policy [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bfa897438554825be52e4c5c45ea3c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2123fd8af384a46bd4d6baee7f1583d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.network.neutron [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updated VIF entry in instance network info cache for port 2e3817c7-d46e-4da7-aecc-6ae6402a3be6. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.network.neutron [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updating instance_info_cache with network_info: [{"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-264d2177-ae9e-4b14-a877-7e80f3586dfe req-ba88cc15-adbf-49dc-aee6-e664c9ebc8ad service nova] Releasing lock "refresh_cache-52205529-6ed5-42f2-b29d-88d4f4b1718e" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:04:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.policy [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a37f1e31ec04baa970afd3400c6f2b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21e9e089edf4ae3b8fcf65f057430e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:04:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Creating image(s)
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "/opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "/opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "/opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Successfully created port: d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG nova.objects.instance [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lazy-loading 'flavor' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:01 user nova-compute[75244]: INFO nova.compute.manager [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Attaching volume 347cc3cd-92b8-445e-8f07-da56f58e129b to /dev/vdb
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk 1073741824" returned: 0 in 0.060s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG os_brick.utils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[509c2a7d-1343-49f8-9256-cfcab5c8cfea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058bcbd-a755-48ce-b0df-b7ee46163c83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f521e2-93ac-4b27-8bf6-c4b0712c34b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[246337b1-c4fb-46fd-b12b-bb9d69cd9ffe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-changed-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Refreshing instance network info cache due to event network-changed-ff31a3d0-b874-45be-b780-cfa11a7053d0. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] Acquiring lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] Acquired lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Refreshing network info cache for port ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:02 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7376af44-41d2-4453-b6ad-0a05bbf48167]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG os_brick.utils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updating existing volume attachment record: 260dbea5-9dcb-405d-927b-0d8e4018c1a0 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.229s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Successfully updated port: d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-changed-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Refreshing instance network info cache due to event network-changed-d5854fe0-5124-4447-a247-16563f42f3fa. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] Acquiring lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] Acquired lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Refreshing network info cache for port d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Cannot resize image /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Ensure instance console log exists: /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Successfully created port: 2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Added VIF to instance network info cache for port d5854fe0-5124-4447-a247-16563f42f3fa. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3488}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eac6a223-e1af-4933-81b0-207e164c7d10 req-1df9f67f-61e9-447b-b9ae-1dbc2494aa82 service nova] Releasing lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquired lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:04:02 user nova-compute[75244]: WARNING nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] 2cff97f6-c8bc-41d3-a6ad-498ece540aec already exists in list: networks containing: ['2cff97f6-c8bc-41d3-a6ad-498ece540aec']. ignoring it
Nov 29 23:04:02 user nova-compute[75244]: WARNING nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] d5854fe0-5124-4447-a247-16563f42f3fa already exists in list: port_ids containing: ['d5854fe0-5124-4447-a247-16563f42f3fa']. ignoring it
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.objects.instance [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lazy-loading 'flavor' on Instance uuid 52205529-6ed5-42f2-b29d-88d4f4b1718e {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updated VIF entry in instance network info cache for port ff31a3d0-b874-45be-b780-cfa11a7053d0. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updating instance_info_cache with network_info: [{"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08c68865-fb1f-46ac-883d-91dfdca3e2eb req-ae757c0c-5de7-424f-a571-88d0e7b5e316 service nova] Releasing lock "refresh_cache-f0ba7f3a-d135-415c-a9dd-38c568e26e15" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:03 user nova-compute[75244]: INFO nova.compute.manager [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Attaching volume 20e87c47-cee6-4969-9c31-7c730cd3f2e7 to /dev/sdc
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.utils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[99231372-1930-4641-b4de-af7a016cb4fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Releasing lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_vif [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b147c7-4357-4258-8cdf-53d18474bf5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99a25cd7-3fcb-5fcc-8a96-940385ef30e4', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSWxVioE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:03 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:03 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:03 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4001d43d-4e6d-46a5-b8a3-87c809ce03bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5854fe0-51, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5854fe0-51, col_values=(('qos', UUID('fbe22ef8-d1f6-4c79-acfa-bacbc3586d7e')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5854fe0-51, col_values=(('external_ids', {'iface-id': 'd5854fe0-5124-4447-a247-16563f42f3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:82:e1', 'vm-uuid': 'c81a4813-3b3c-4bf1-a3fe-d623aab59a1c'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5342a40-39d3-4eb1-8377-63e33c8b5257]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b0993e-b4c5-4048-9ed5-23eea983ad74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:03 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:03 user nova-compute[75244]: INFO os_vif [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51')
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] attach device xml: <interface type="ethernet">
Nov 29 23:04:03 user nova-compute[75244]:   <mac address="fa:16:3e:73:82:e1"/>
Nov 29 23:04:03 user nova-compute[75244]:   <model type="virtio"/>
Nov 29 23:04:03 user nova-compute[75244]:   <mtu size="1442"/>
Nov 29 23:04:03 user nova-compute[75244]:   <target dev="tapd5854fe0-51"/>
Nov 29 23:04:03 user nova-compute[75244]: </interface>
Nov 29 23:04:03 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48bd257-b6b0-4ce2-9ac5-1d46d98e0728]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6] added
Nov 29 23:04:03 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:03 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab0e34c-ed02-4003-9c3a-56e3bf6c192c]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.utils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updating existing volume attachment record: eefd26ad-e57e-4a5e-ba91-c9b316a3ae62 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23041adf-fcdb-4e8a-a8ee-567dff9c2c00]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1b1a2-3e39-4751-819b-a0f95b3e213d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSWxVioE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSWxVioE" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[677eed8a-d50d-45cf-be03-81fcb5155753]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSWxVioE'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[347cdc26-7e81-4737-99ba-0781de0e8d29]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d7ece4-7d86-4bda-8c20-d47321087e26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:03 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:03 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:03 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:03 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:03 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:03 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:03 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:03 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9546895-d90e-4752-b51a-82581732c606]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260]
Nov 29 23:04:04 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Successfully updated port: 2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf28f0-d862-408b-8af0-ebd07d4fe306]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquired lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:04 user nova-compute[75244]: WARNING nova.compute.manager [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state stopped and task_state None.
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:04 user nova-compute[75244]: WARNING nova.compute.manager [req-73037731-a7a9-484b-881d-6968cb12dff7 req-4173ac15-ac8a-4808-b2ca-121a63bf1ad7 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state stopped and task_state None.
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[234250c8-ff4e-45ac-af54-e4be18a9889c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-changed-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Refreshing instance network info cache due to event network-changed-2721fa9f-cbf6-4e2b-979a-e045ae5547fb. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] Acquiring lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:04 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb69f31-f58a-4270-961d-cd7d8ec3bda1]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSWxVioE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No BDM found with device name hda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No VIF found with MAC fa:16:3e:37:d9:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:04:04 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:04:04 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:04:04 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:04:04</nova:creationTime>
Nov 29 23:04:04 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:04:04 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:04:04 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:04:04 user nova-compute[75244]:   <nova:owner>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:04:04 user nova-compute[75244]:   </nova:owner>
Nov 29 23:04:04 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:04:04 user nova-compute[75244]:   <nova:ports>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:04:04 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:04:04 user nova-compute[75244]:     </nova:port>
Nov 29 23:04:04 user nova-compute[75244]:     <nova:port uuid="d5854fe0-5124-4447-a247-16563f42f3fa">
Nov 29 23:04:04 user nova-compute[75244]:       <nova:ip type="fixed" address="10.10.10.45" ipVersion="4"/>
Nov 29 23:04:04 user nova-compute[75244]:     </nova:port>
Nov 29 23:04:04 user nova-compute[75244]:   </nova:ports>
Nov 29 23:04:04 user nova-compute[75244]: </nova:instance>
Nov 29 23:04:04 user nova-compute[75244]:  {{(pid=75244) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9f9b734-6634-4776-9ab7-043f44796cc9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "interface-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.875s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lazy-loading 'flavor' on Instance uuid 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updating instance_info_cache with network_info: [{"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Releasing lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Instance network_info: |[{"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] Acquired lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Refreshing network info cache for port 2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Start _get_guest_xml network_info=[{"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:04:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:04:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1417893',id=13,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCp3ZSrDQfICWcr+RwWsO7uIk+QWcCsYwEBWXxNaOCR+Bzn54v7N3kFH70uwIHZADRt754FvtXFyfOHJiDar4JsL9lP+TYGGY6D0AkGX10OOCUrsaBNdkYZiPWoL/Qzbw==',key_name='tempest-keypair-482319447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d21e9e089edf4ae3b8fcf65f057430e4',ramdisk_id='',reservation_id='r-wnju16a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151225029',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a37f1e31ec04baa970afd3400c6f2b9',uuid=d659418e-64fb-4c3e-9569-7011295c252b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Converting VIF {"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.objects.instance [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lazy-loading 'pci_devices' on Instance uuid d659418e-64fb-4c3e-9569-7011295c252b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:04:05 user nova-compute[75244]:   <uuid>d659418e-64fb-4c3e-9569-7011295c252b</uuid>
Nov 29 23:04:05 user nova-compute[75244]:   <name>instance-0000000d</name>
Nov 29 23:04:05 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:04:05 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:04:05 user nova-compute[75244]:   <metadata>
Nov 29 23:04:05 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:04:05 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:04:05 user nova-compute[75244]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341</nova:name>
Nov 29 23:04:05 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:04:05</nova:creationTime>
Nov 29 23:04:05 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:04:05 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:04:05 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:04:05 user nova-compute[75244]:       <nova:owner>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:user uuid="3a37f1e31ec04baa970afd3400c6f2b9">tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member</nova:user>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:project uuid="d21e9e089edf4ae3b8fcf65f057430e4">tempest-TestServerVolumeAttachScenarioOldVersion-151225029</nova:project>
Nov 29 23:04:05 user nova-compute[75244]:       </nova:owner>
Nov 29 23:04:05 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:04:05 user nova-compute[75244]:       <nova:ports>
Nov 29 23:04:05 user nova-compute[75244]:         <nova:port uuid="2721fa9f-cbf6-4e2b-979a-e045ae5547fb">
Nov 29 23:04:05 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:04:05 user nova-compute[75244]:         </nova:port>
Nov 29 23:04:05 user nova-compute[75244]:       </nova:ports>
Nov 29 23:04:05 user nova-compute[75244]:     </nova:instance>
Nov 29 23:04:05 user nova-compute[75244]:   </metadata>
Nov 29 23:04:05 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:04:05 user nova-compute[75244]:     <system>
Nov 29 23:04:05 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:04:05 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:04:05 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:04:05 user nova-compute[75244]:       <entry name="serial">d659418e-64fb-4c3e-9569-7011295c252b</entry>
Nov 29 23:04:05 user nova-compute[75244]:       <entry name="uuid">d659418e-64fb-4c3e-9569-7011295c252b</entry>
Nov 29 23:04:05 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:04:05 user nova-compute[75244]:     </system>
Nov 29 23:04:05 user nova-compute[75244]:   </sysinfo>
Nov 29 23:04:05 user nova-compute[75244]:   <os>
Nov 29 23:04:05 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:04:05 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:04:05 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:04:05 user nova-compute[75244]:   </os>
Nov 29 23:04:05 user nova-compute[75244]:   <features>
Nov 29 23:04:05 user nova-compute[75244]:     <acpi/>
Nov 29 23:04:05 user nova-compute[75244]:     <apic/>
Nov 29 23:04:05 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:04:05 user nova-compute[75244]:   </features>
Nov 29 23:04:05 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:04:05 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:04:05 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:04:05 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:04:05 user nova-compute[75244]:   </clock>
Nov 29 23:04:05 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:04:05 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:04:05 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:04:05 user nova-compute[75244]:   </cpu>
Nov 29 23:04:05 user nova-compute[75244]:   <devices>
Nov 29 23:04:05 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:04:05 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:04:05 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk"/>
Nov 29 23:04:05 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:04:05 user nova-compute[75244]:     </disk>
Nov 29 23:04:05 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:04:05 user nova-compute[75244]:       <mac address="fa:16:3e:6c:c6:b4"/>
Nov 29 23:04:05 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:04:05 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:04:05 user nova-compute[75244]:       <target dev="tap2721fa9f-cb"/>
Nov 29 23:04:05 user nova-compute[75244]:     </interface>
Nov 29 23:04:05 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:04:05 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/console.log" append="off"/>
Nov 29 23:04:05 user nova-compute[75244]:     </serial>
Nov 29 23:04:05 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:04:05 user nova-compute[75244]:     <video>
Nov 29 23:04:05 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:04:05 user nova-compute[75244]:     </video>
Nov 29 23:04:05 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:04:05 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:04:05 user nova-compute[75244]:     </rng>
Nov 29 23:04:05 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:04:05 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:04:05 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:04:05 user nova-compute[75244]:     </memballoon>
Nov 29 23:04:05 user nova-compute[75244]:   </devices>
Nov 29 23:04:05 user nova-compute[75244]: </domain>
Nov 29 23:04:05 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1417893',id=13,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCp3ZSrDQfICWcr+RwWsO7uIk+QWcCsYwEBWXxNaOCR+Bzn54v7N3kFH70uwIHZADRt754FvtXFyfOHJiDar4JsL9lP+TYGGY6D0AkGX10OOCUrsaBNdkYZiPWoL/Qzbw==',key_name='tempest-keypair-482319447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d21e9e089edf4ae3b8fcf65f057430e4',ramdisk_id='',reservation_id='r-wnju16a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151225029',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a37f1e31ec04baa970afd3400c6f2b9',uuid=d659418e-64fb-4c3e-9569-7011295c252b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Converting VIF {"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_vif [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1b4dbb7-ee2f-5b3f-9bb6-4c570552838e', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:05 user nova-compute[75244]: INFO nova.compute.manager [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Attaching volume 2c2b167f-d93c-48be-95c4-3267b89a3e46 to /dev/vdb
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2721fa9f-cb, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2721fa9f-cb, col_values=(('qos', UUID('96b865f3-7452-4191-87a7-0e30cf716c41')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2721fa9f-cb, col_values=(('external_ids', {'iface-id': '2721fa9f-cbf6-4e2b-979a-e045ae5547fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:c6:b4', 'vm-uuid': 'd659418e-64fb-4c3e-9569-7011295c252b'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:05 user nova-compute[75244]: INFO os_vif [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb')
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.objects.instance [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'flavor' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23830633534376264', 'path': '/dev/sdf'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633534376264', 'path': '/dev/sdf'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'flavor' on Instance uuid f2b866e9-d721-494e-b4ce-9605047d87de {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] No VIF found with MAC fa:16:3e:6c:c6:b4, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:04:05 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:05 user nova-compute[75244]:   <source dev="/dev/sdf"/>
Nov 29 23:04:05 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:05 user nova-compute[75244]:   <serial>949a2bab-1640-44d8-8aa1-7b9eab2913b6</serial>
Nov 29 23:04:05 user nova-compute[75244]: </disk>
Nov 29 23:04:05 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.utils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1353db7e-add1-4bd9-afe6-90c02aa129ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e0637f-fe50-4331-aa3d-76b3a464f0d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac92a00-ac67-433c-bd91-a1b5f0edeb4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a5fe6-50e2-45e8-9acd-795b4ea33ea6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:05 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e88dc7-4ec4-4a48-a96e-87fe552616be]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG os_brick.utils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Updating existing volume attachment record: 243f6132-0049-4a04-a55a-e019377db075 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:05 user nova-compute[75244]: INFO nova.compute.manager [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Attaching volume b5ac9111-8a67-43b4-9f25-13b9dcfd7366 to /dev/vdb
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updated VIF entry in instance network info cache for port 2721fa9f-cbf6-4e2b-979a-e045ae5547fb. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updating instance_info_cache with network_info: [{"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0d95c43b-3ed0-4f54-ba89-164ea8273d63 req-7610a301-0cb1-4227-9011-097e8567ff1c service nova] Releasing lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No VIF found with MAC fa:16:3e:b7:32:40, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-changed-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Refreshing instance network info cache due to event network-changed-7156989c-5e7f-44b1-986e-6a0e3b698c94. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Acquiring lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Acquired lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Refreshing network info cache for port 7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Updated VIF entry in instance network info cache for port 7156989c-5e7f-44b1-986e-6a0e3b698c94. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Updating instance_info_cache with network_info: [{"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Releasing lock "refresh_cache-75dbc99c-86b4-408b-b35e-be8365c8fcf6" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:06 user nova-compute[75244]: WARNING nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa for instance with vm_state active and task_state None.
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:06 user nova-compute[75244]: WARNING nova.compute.manager [req-ac096af7-dc8a-41f9-94c6-980dece11b8b req-4e142b86-8dbd-4175-ba46-5007a23a7269 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa for instance with vm_state active and task_state None.
Nov 29 23:04:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] No waiting events found dispatching network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:08 user nova-compute[75244]: WARNING nova.compute.manager [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received unexpected event network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb for instance with vm_state building and task_state spawning.
Nov 29 23:04:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] No waiting events found dispatching network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:08 user nova-compute[75244]: WARNING nova.compute.manager [req-461aff4d-1021-4539-a100-06cf452ce605 req-db1453ec-e2a9-4283-a5e0-487f176c1dc0 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received unexpected event network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb for instance with vm_state building and task_state spawning.
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:04:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Instance spawned successfully.
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:09 user nova-compute[75244]: INFO nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Took 7.97 seconds to spawn the instance on the hypervisor.
Nov 29 23:04:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:04:09 user nova-compute[75244]: INFO nova.compute.manager [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Took 8.89 seconds to build instance.
Nov 29 23:04:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0587280f-fb51-466f-baab-ca3593c889e4 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.004s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:11 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:11 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:11 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[70096f43-693a-4daf-b1ae-5d22c2064321]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:11 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc13cb6-6210-49a1-80cd-a217fa0460cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b] added
Nov 29 23:04:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[08030f75-12cb-43c9-b43d-af4d2fb742f5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c31fcaa-5ec4-4721-9296-70d875bfcf8b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knIiAYRs {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knIiAYRs" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ee649-c072-486e-a004-3e7eccde7e49]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knIiAYRs'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6ff21fd9-97fd-4670-a314-87634e2c842d tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.126s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de53e96b-c2b8-417f-bb0c-2e5000699d78]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8792fe7-1037-4bdc-9e77-0c9e136f6fc2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c8ac04-19b0-45b5-aa26-a0b27f05d53b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]
Nov 29 23:04:11 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a22a0-9f14-4dbd-b6b7-67ad6030f0be]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[484834f4-7d73-4970-9dda-59d9d4b5a06d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:11 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d11e9-11fe-44b0-96aa-cc8a77504e76]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.utils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb8b32d-65bb-42ea-9595-4d3a09ed0b14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1f069-9a73-403d-a658-12541a2c5cf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f3823-4481-4f4b-82f6-d9d9c1363982]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[946038cd-04c9-42b4-941e-089aebe586c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:11 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:04:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ac7d9-570a-4457-a76e-85dbe7337b83]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG os_brick.utils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:11 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating existing volume attachment record: 5df99501-79a1-4399-94d5-7fe07e7c4f96 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26232393165343437', 'path': '/dev/sdg'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232393165343437', 'path': '/dev/sdg'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG nova.objects.instance [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lazy-loading 'flavor' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:04:12 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:12 user nova-compute[75244]:   <source dev="/dev/sdg"/>
Nov 29 23:04:12 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:12 user nova-compute[75244]:   <serial>347cc3cd-92b8-445e-8f07-da56f58e129b</serial>
Nov 29 23:04:12 user nova-compute[75244]: </disk>
Nov 29 23:04:12 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOSWkKfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:12 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[abade457-0fc8-42c6-b47b-f857d5249042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:12 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6192ede-b00d-4816-a010-6ef430b91911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7] added
Nov 29 23:04:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bf7c16-a0ce-45bd-8c8e-1ab88394b256]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[877c6936-8d60-4b2b-aeb7-b17c4ec548ff]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOSWkKfo {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOSWkKfo" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c007cd-0837-4f54-8266-c56b9d7c422b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GOSWkKfo'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] No VIF found with MAC fa:16:3e:36:c5:36, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d003c-d4a7-40cb-9b5a-78d9adad73ce]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d16e8d-1b2e-4759-8cea-8a3624ca419a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c45efe-8b6c-404b-a168-9d7d00c2e300]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260]
Nov 29 23:04:13 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f50dbc-49e2-4732-a3d4-fb1fd5b76dbe]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c0fd16-5945-473a-9bf7-bd61d133ddbf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:13 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fd2a25-7359-4669-b9d5-2b061f05c704]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOSWkKfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-049e233c-069e-4348-acb7-0e72d29f5684 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.570s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:13 user nova-compute[75244]: INFO nova.compute.manager [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Detaching volume 949a2bab-1640-44d8-8aa1-7b9eab2913b6
Nov 29 23:04:13 user nova-compute[75244]: INFO nova.virt.block_device [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Attempting to driver detach volume 949a2bab-1640-44d8-8aa1-7b9eab2913b6 from mountpoint /dev/vdb
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Attempting to detach device vdb from instance f2b866e9-d721-494e-b4ce-9605047d87de from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:13 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:13 user nova-compute[75244]:   <source dev="/dev/sdf"/>
Nov 29 23:04:13 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:13 user nova-compute[75244]:   <serial>949a2bab-1640-44d8-8aa1-7b9eab2913b6</serial>
Nov 29 23:04:13 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:04:13 user nova-compute[75244]: </disk>
Nov 29 23:04:13 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Successfully detached device vdb from instance f2b866e9-d721-494e-b4ce-9605047d87de from the persistent domain config.
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2b866e9-d721-494e-b4ce-9605047d87de from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:04:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:13 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:13 user nova-compute[75244]:   <source dev="/dev/sdf"/>
Nov 29 23:04:13 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:13 user nova-compute[75244]:   <serial>949a2bab-1640-44d8-8aa1-7b9eab2913b6</serial>
Nov 29 23:04:13 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:04:13 user nova-compute[75244]: </disk>
Nov 29 23:04:13 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2b866e9-d721-494e-b4ce-9605047d87de {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23139363764396164', 'path': '/dev/sdh'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139363764396164', 'path': '/dev/sdh'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.objects.instance [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lazy-loading 'flavor' on Instance uuid 52205529-6ed5-42f2-b29d-88d4f4b1718e {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:04:14 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:14 user nova-compute[75244]:   <source dev="/dev/sdh"/>
Nov 29 23:04:14 user nova-compute[75244]:   <target dev="sdc" bus="scsi"/>
Nov 29 23:04:14 user nova-compute[75244]:   <serial>20e87c47-cee6-4969-9c31-7c730cd3f2e7</serial>
Nov 29 23:04:14 user nova-compute[75244]:   <address type="drive" controller="0" unit="2"/>
Nov 29 23:04:14 user nova-compute[75244]: </disk>
Nov 29 23:04:14 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.utils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[95783d22-b1ca-4257-aec4-4320d60abfa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fd3958-7bcd-4f4a-bd72-53900a747f06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjFCUBmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.010s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:14 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d1003-5e82-4d7e-ade0-c05bfe6c0335]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd76ed3-279e-4a2e-bcc5-be7c4f2558b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d97c0-271e-467c-9680-24c93991eca1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:14 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No BDM found with device name sda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] No VIF found with MAC fa:16:3e:ea:a6:d4, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:14 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45efac1b-64c6-4694-a491-800b09301618]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.utils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4b7e2a-f0d1-41b6-8526-ce51fdb6cf4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46] added
Nov 29 23:04:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eec64b-3e53-4925-ad47-363543ff92c5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[17360fdd-8fb3-4072-8df8-ad4f8b54d5bc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjFCUBmL {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjFCUBmL" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c3c70-6831-433a-9816-da694c8160e2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjFCUBmL'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb7a79-6e36-4c8e-a928-fbd40ce311aa]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:15 user nova-compute[75244]: INFO nova.compute.manager [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Swapping volume 347cc3cd-92b8-445e-8f07-da56f58e129b for 95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89585e95-026f-4a7b-92ae-93aecb6eb66c tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.485s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfcafcd-3cfd-4dc7-b757-3b14c99e420a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf1ded4-d11d-4a13-b9df-097d070a078d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260]
Nov 29 23:04:15 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6c41b-65f5-4518-a326-a6746e6526a0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b269a84-1f36-48ed-8de4-b424486bb3b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:15 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5792d0-ce8a-411c-8019-81b23e6baeae]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjFCUBmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:15 user nova-compute[75244]: INFO nova.compute.manager [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Detaching volume 20e87c47-cee6-4969-9c31-7c730cd3f2e7
Nov 29 23:04:15 user nova-compute[75244]: INFO nova.virt.block_device [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Attempting to driver detach volume 20e87c47-cee6-4969-9c31-7c730cd3f2e7 from mountpoint /dev/sdc
Nov 29 23:04:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Attempting to detach device sdc from instance 52205529-6ed5-42f2-b29d-88d4f4b1718e from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:15 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:15 user nova-compute[75244]:   <source dev="/dev/sdh"/>
Nov 29 23:04:15 user nova-compute[75244]:   <target dev="sdc" bus="scsi"/>
Nov 29 23:04:15 user nova-compute[75244]:   <serial>20e87c47-cee6-4969-9c31-7c730cd3f2e7</serial>
Nov 29 23:04:15 user nova-compute[75244]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 23:04:15 user nova-compute[75244]: </disk>
Nov 29 23:04:15 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Successfully detached device sdc from instance 52205529-6ed5-42f2-b29d-88d4f4b1718e from the persistent domain config.
Nov 29 23:04:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 52205529-6ed5-42f2-b29d-88d4f4b1718e from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:04:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:15 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:15 user nova-compute[75244]:   <source dev="/dev/sdh"/>
Nov 29 23:04:15 user nova-compute[75244]:   <target dev="sdc" bus="scsi"/>
Nov 29 23:04:15 user nova-compute[75244]:   <serial>20e87c47-cee6-4969-9c31-7c730cd3f2e7</serial>
Nov 29 23:04:15 user nova-compute[75244]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 23:04:15 user nova-compute[75244]: </disk>
Nov 29 23:04:15 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 52205529-6ed5-42f2-b29d-88d4f4b1718e {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26535323239363835', 'path': '/dev/sdi'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535323239363835', 'path': '/dev/sdi'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lazy-loading 'flavor' on Instance uuid 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 23:04:16 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:16 user nova-compute[75244]:   <source dev="/dev/sdi"/>
Nov 29 23:04:16 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:16 user nova-compute[75244]:   <serial>2c2b167f-d93c-48be-95c4-3267b89a3e46</serial>
Nov 29 23:04:16 user nova-compute[75244]: </disk>
Nov 29 23:04:16 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] No VIF found with MAC fa:16:3e:23:28:c0, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-92a2c490-5a71-429b-8ac8-9eda4d3ad129 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.846s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] volume_snapshot_create: create_info: {'snapshot_id': 'a786c7c3-8cc6-435b-a1cb-8f29a894302e', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75244) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 23:04:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] snap xml: <domainsnapshot>
Nov 29 23:04:17 user nova-compute[75244]:   <disks>
Nov 29 23:04:17 user nova-compute[75244]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 29 23:04:17 user nova-compute[75244]:       <source file="/dev/new_file"/>
Nov 29 23:04:17 user nova-compute[75244]:     </disk>
Nov 29 23:04:17 user nova-compute[75244]:     <disk name="vda" snapshot="no"/>
Nov 29 23:04:17 user nova-compute[75244]:   </disks>
Nov 29 23:04:17 user nova-compute[75244]: </domainsnapshot>
Nov 29 23:04:17 user nova-compute[75244]:  {{(pid=75244) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 23:04:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] Lazy-loading 'system_metadata' on Instance uuid 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     rv = execute(f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     six.reraise(c, e, tb)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     raise value
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     rv = meth(*args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     self._volume_snapshot_create(context, instance, guest,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     rv = execute(f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     six.reraise(c, e, tb)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     raise value
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     rv = meth(*args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] 
Nov 29 23:04:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f3d49b56-f727-496f-b80e-c07813402fac tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] volume_snapshot_delete: delete_info: {'volume_id': '2c2b167f-d93c-48be-95c4-3267b89a3e46'} {{(pid=75244) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [None req-f3d49b56-f727-496f-b80e-c07813402fac tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6]     if delete_info['type'] != 'qcow2':
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] KeyError: 'type'
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a786c7c3-8cc6-435b-a1cb-8f29a894302e could not be found.
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a786c7c3-8cc6-435b-a1cb-8f29a894302e could not be found. (HTTP 404) (Request-ID: req-92f9f767-a673-4725-973d-4a6bc8055bff)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a786c7c3-8cc6-435b-a1cb-8f29a894302e could not be found.
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server [None req-ca90d854-0ad6-4cea-a1c8-35509c7fe2d4 tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver [None req-f3d49b56-f727-496f-b80e-c07813402fac tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9bd3b766-eb5f-4874-943b-44667eee2d81)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 23:04:17 user nova-compute[75244]: ERROR nova.virt.libvirt.driver 
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server [None req-f3d49b56-f727-496f-b80e-c07813402fac tempest-VolumesAssistedSnapshotsTest-1217410472 tempest-VolumesAssistedSnapshotsTest-1217410472-project] Exception during message handling: KeyError: 'type'
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 23:04:17 user nova-compute[75244]: ERROR oslo_messaging.rpc.server 
Nov 29 23:04:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:18 user nova-compute[75244]: INFO nova.compute.manager [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Detaching volume 2c2b167f-d93c-48be-95c4-3267b89a3e46
Nov 29 23:04:18 user nova-compute[75244]: INFO nova.virt.block_device [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Attempting to driver detach volume 2c2b167f-d93c-48be-95c4-3267b89a3e46 from mountpoint /dev/vdb
Nov 29 23:04:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Attempting to detach device vdb from instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:04:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:18 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:18 user nova-compute[75244]:   <source dev="/dev/sdi"/>
Nov 29 23:04:18 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:18 user nova-compute[75244]:   <serial>2c2b167f-d93c-48be-95c4-3267b89a3e46</serial>
Nov 29 23:04:18 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:04:18 user nova-compute[75244]: </disk>
Nov 29 23:04:18 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Successfully detached device vdb from instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 from the persistent domain config.
Nov 29 23:04:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:04:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:18 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:18 user nova-compute[75244]:   <source dev="/dev/sdi"/>
Nov 29 23:04:18 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:18 user nova-compute[75244]:   <serial>2c2b167f-d93c-48be-95c4-3267b89a3e46</serial>
Nov 29 23:04:18 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:04:18 user nova-compute[75244]: </disk>
Nov 29 23:04:18 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:04:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePSGfHns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:20 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:20 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:20 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7032a-08f4-4277-9238-6a88a90a6020]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:20 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d904ac-e7f2-410c-ab6b-a5faa741a51d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366] added
Nov 29 23:04:20 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2da41-5726-46a4-b223-07f7edc2c248]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faaee50-0422-45c0-8ac6-60321e11c961]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePSGfHns {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePSGfHns" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ce5a69-5007-455d-a6d2-16a6dd219c6b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePSGfHns'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fecf0e-4e58-46d0-b5e8-c317208c9726]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c4a2e-2fce-4cea-82df-bdce44c7a567]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2e989e-a9dd-4178-8c32-fd36951d5df9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260]
Nov 29 23:04:21 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40bfe6-d01d-4123-8fa1-1119652fe4e2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[87330a58-91dc-4022-8c16-4556797730c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:21 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a0d006-8d40-4b52-ac8f-81fb4e14532c]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePSGfHns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23935323436376562', 'path': '/dev/sdj'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935323436376562', 'path': '/dev/sdj'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'flavor' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:04:22 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:22 user nova-compute[75244]:   <source dev="/dev/sdj"/>
Nov 29 23:04:22 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:22 user nova-compute[75244]:   <serial>b5ac9111-8a67-43b4-9f25-13b9dcfd7366</serial>
Nov 29 23:04:22 user nova-compute[75244]: </disk>
Nov 29 23:04:22 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No BDM found with device name hda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] No VIF found with MAC fa:16:3e:37:d9:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e4a7b4-e009-4dd6-aec7-0b869442fac9 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.324s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:23 user nova-compute[75244]: INFO nova.compute.manager [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Detaching volume b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:23 user nova-compute[75244]: INFO nova.virt.block_device [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Attempting to driver detach volume b5ac9111-8a67-43b4-9f25-13b9dcfd7366 from mountpoint /dev/vdb
Nov 29 23:04:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Attempting to detach device vdb from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:04:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:23 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:23 user nova-compute[75244]:   <source dev="/dev/sdj"/>
Nov 29 23:04:23 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:23 user nova-compute[75244]:   <serial>b5ac9111-8a67-43b4-9f25-13b9dcfd7366</serial>
Nov 29 23:04:23 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 23:04:23 user nova-compute[75244]: </disk>
Nov 29 23:04:23 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully detached device vdb from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the persistent domain config.
Nov 29 23:04:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:04:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:23 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:23 user nova-compute[75244]:   <source dev="/dev/sdj"/>
Nov 29 23:04:23 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:23 user nova-compute[75244]:   <serial>b5ac9111-8a67-43b4-9f25-13b9dcfd7366</serial>
Nov 29 23:04:23 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 23:04:23 user nova-compute[75244]: </disk>
Nov 29 23:04:23 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhovImxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15', 'attached_at': '', 'detached_at': '', 'volume_id': '95e5c669-48fb-409e-8e88-813215c0eb5a', 'serial': '95e5c669-48fb-409e-8e88-813215c0eb5a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15', 'attached_at': '', 'detached_at': '', 'volume_id': '347cc3cd-92b8-445e-8f07-da56f58e129b', 'serial'} {{(pid=75244) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhovImxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:24 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:24 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:24 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2899c-b716-4428-8e1d-6f4238eb044b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:24 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6222d3-7cc4-4926-a5be-1feb77621c0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a] added
Nov 29 23:04:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df8c5c-ed3e-4a1c-93f1-39ebee551b29]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[36860348-33d3-4854-93c5-f0dd21e19ba6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhovImxN {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhovImxN" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff63cf75-7230-48bf-8a1e-e959aee85f6e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhovImxN'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f4981f-a69a-416d-a93c-c77dd2a6a7e7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b413d-6f40-4595-9be1-7a0a0365991a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b466a9cb-f95f-4bb2-b86d-98e474d8dd80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260]
Nov 29 23:04:24 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.087s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11298a0b-8473-47da-8d33-794d2ddc9f5f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[977bc6fc-b7aa-415c-992e-2507cb36038f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:24 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0da2df-d32d-4021-a5fb-1f280d8975be]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhovImxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.534s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] <== connect_volume: return (1535ms) {'type': 'block', 'scsi_wwn': '23563333331376230', 'path': '/dev/sdk'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563333331376230', 'path': '/dev/sdk'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:25 user nova-compute[75244]: DEBUG nova.objects.instance [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lazy-loading 'flavor' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 512753664 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 704643072 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 859832320 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 1012924416 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:29 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc13e035-0cab-46a9-8c7f-e2366267b6db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:29 user nova-compute[75244]: No targets found.
Nov 29 23:04:29 user nova-compute[75244]: iSNS:
Nov 29 23:04:29 user nova-compute[75244]: No targets found.
Nov 29 23:04:29 user nova-compute[75244]: STATIC:
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c
Nov 29 23:04:29 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:29 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:29 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:29 user nova-compute[75244]: No targets found.
Nov 29 23:04:29 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:29 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:29 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38cd6cb-736e-4ef1-b165-f5e0beb3d9e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea9770-897f-4d4b-b9f9-5135ca3ac35a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:29 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:29 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c474940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b'): ({'sdg'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Removing single pathed devices sdg {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7271d2-bbe4-4c39-ac19-cd0a1cca827e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9a3af-b03e-4804-8ba9-c88c9020b6ad]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Flushing IO for device /dev/sdg {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd6592-c98b-4ae6-bf2d-38e86d7dcbf1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af71444-d482-48e8-9a1c-37127dc3aca1]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] SCSI volumes sdg have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56182920-c71e-421e-989f-0eac2b0a9ab9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae24e28-964f-4058-84f7-f4c2cdda27f4]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]
Nov 29 23:04:30 user nova-compute[75244]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:30 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090a638-5ff9-48a5-a3d4-1d24758859a0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] <== disconnect_volume: return (341ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhovImxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15', 'attached_at': '', 'detached_at': '', 'volume_id': '95e5c669-48fb-409e-8e88-813215c0eb5a', 'serial'} {{(pid=75244) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] swap_volume: removing Cinder connection for volume 347cc3cd-92b8-445e-8f07-da56f58e129b {{(pid=75244) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] swap_volume: Updating volume 347cc3cd-92b8-445e-8f07-da56f58e129b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "fhovImxN", "auth_password": "I8xFUfOAbniH25", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "95e5c669-48fb-409e-8e88-813215c0eb5a"}, "status": "reserved", "instance": "f0ba7f3a-d135-415c-a9dd-38c568e26e15", "attached_at": "", "detached_at": "", "volume_id": "95e5c669-48fb-409e-8e88-813215c0eb5a", "serial": "95e5c669-48fb-409e-8e88-813215c0eb5a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '95e5c669-48fb-409e-8e88-813215c0eb5a', 'no_device': None, 'attachment_id': '9265ab97-5f59-4c0f-af0e-3048de520510'} {{(pid=75244) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-495aa904-5c29-48f6-8755-6d08c331e597 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.316s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG os_brick.utils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f90d07-0a38-4d7b-bc1d-ee6c75a5a520]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023e94e-a62d-40be-8112-35ad53b9843e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[408fbef4-357b-480b-a7d7-dad3d46086d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad29651-d7bb-4497-b9a8-d49188d41a86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:04:32 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4cd31c-6d8c-47b2-aadb-4f14a7ab9946]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG os_brick.utils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:32 user nova-compute[75244]: INFO nova.compute.manager [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Swapping volume 95e5c669-48fb-409e-8e88-813215c0eb5a for 347cc3cd-92b8-445e-8f07-da56f58e129b
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2b866e9-d721-494e-b4ce-9605047d87de is timed out.
Nov 29 23:04:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Successfully detached device vdb from instance f2b866e9-d721-494e-b4ce-9605047d87de from the live domain config.
Nov 29 23:04:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSWxVioE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:34 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d67f97e-5922-48ae-9c65-2be9f508ec07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:34 user nova-compute[75244]: No targets found.
Nov 29 23:04:34 user nova-compute[75244]: iSNS:
Nov 29 23:04:34 user nova-compute[75244]: No targets found.
Nov 29 23:04:34 user nova-compute[75244]: STATIC:
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c
Nov 29 23:04:34 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:34 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:34 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:34 user nova-compute[75244]: No targets found.
Nov 29 23:04:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:34 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:34 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4383e-8e46-4bb9-94c6-6968f963fd28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0857c2f3-f896-4e67-842f-b8bbccc643b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c1abd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6'): ({'sdf'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Removing single pathed devices sdf {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed6f422-467e-4954-849c-d63257016e5d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0005fbfc-17b1-414b-abb2-fe8328364aac]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Flushing IO for device /dev/sdf {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5643336-9609-4d81-be09-fe5d72ffb740]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d32c18-c3f6-4a6f-860a-c1c7cc5f8ecd]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2790b3c-5fdc-4cdf-9c9d-9cddaa2c1da2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5dddcb-bfb5-43a6-a28e-1f81f8995741]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260]
Nov 29 23:04:34 user nova-compute[75244]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:34 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949a2bab-1640-44d8-8aa1-7b9eab2913b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e6ab70-cae7-4616-9677-9f03a1f77a6f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] <== disconnect_volume: return (433ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-changed-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing instance network info cache due to event network-changed-330c9b41-e54a-463e-afa8-d021a11900bc. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] Acquiring lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] Acquired lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG nova.network.neutron [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Refreshing network info cache for port 330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:04:35 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'flavor' on Instance uuid f2b866e9-d721-494e-b4ce-9605047d87de {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:04:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7285MB free_disk=25.294429779052734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4bc35899-0353-4b37-9f9c-7c3e27768394 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.328s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f2b866e9-d721-494e-b4ce-9605047d87de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 52205529-6ed5-42f2-b29d-88d4f4b1718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance c8b888b3-9f53-4681-b46a-73b04625edd3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 254dca38-2e6d-4303-86af-369275d7529f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance d659418e-64fb-4c3e-9569-7011295c252b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:04:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 52205529-6ed5-42f2-b29d-88d4f4b1718e is timed out.
Nov 29 23:04:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Successfully detached device sdc from instance 52205529-6ed5-42f2-b29d-88d4f4b1718e from the live domain config.
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOSWkKfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:36 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d2507-3398-4076-8dc3-f2882f78707e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:36 user nova-compute[75244]: No targets found.
Nov 29 23:04:36 user nova-compute[75244]: iSNS:
Nov 29 23:04:36 user nova-compute[75244]: No targets found.
Nov 29 23:04:36 user nova-compute[75244]: STATIC:
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c
Nov 29 23:04:36 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:36 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:36 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:36 user nova-compute[75244]: No targets found.
Nov 29 23:04:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:36 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:36 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0d2e00-46eb-4325-9d15-085c94b3facb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00ffae-2a41-4f85-8a78-013a782b9992]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:36 user nova-compute[75244]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 (non-flash)
Nov 29 23:04:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80438d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7'): ({'sdh'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Removing single pathed devices sdh {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fbbad2-5d04-40d2-ab43-16f26d7490c7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829914b-2249-4a0f-a6e0-bfeb34a8fbc0]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Flushing IO for device /dev/sdh {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[930816e1-a5d0-4914-9818-dd334081d27a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b807b6-43b1-4927-9571-1bcaf7d3840a]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] SCSI volumes sdh have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce44503d-f375-42a8-af21-e268b1bc71f4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[671f0ac9-0afc-47ca-adbc-f25adc3eff9b]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260]
Nov 29 23:04:36 user nova-compute[75244]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20e87c47-cee6-4969-9c31-7c730cd3f2e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c1368-ed80-4cdd-9e34-0e88de6aca61]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] <== disconnect_volume: return (391ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updated VIF entry in instance network info cache for port 330c9b41-e54a-463e-afa8-d021a11900bc. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8d8bd0d3-c600-4020-9787-61f8bbc52a4e req-53dfc103-3e88-48bf-b4a4-37da2e96fc89 service nova] Releasing lock "refresh_cache-c8b888b3-9f53-4681-b46a-73b04625edd3" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:37 user nova-compute[75244]: DEBUG nova.objects.instance [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lazy-loading 'flavor' on Instance uuid 52205529-6ed5-42f2-b29d-88d4f4b1718e {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60943cb8-0b00-4015-954a-0bbb2b68f879 tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.061s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:38 user nova-compute[75244]: INFO nova.compute.manager [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Terminating instance
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34e92ab-d0b1-485e-88ff-70563b7494fd req-b7b94719-59e2-42ad-8fb9-3436282ef933 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34e92ab-d0b1-485e-88ff-70563b7494fd req-b7b94719-59e2-42ad-8fb9-3436282ef933 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34e92ab-d0b1-485e-88ff-70563b7494fd req-b7b94719-59e2-42ad-8fb9-3436282ef933 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f34e92ab-d0b1-485e-88ff-70563b7494fd req-b7b94719-59e2-42ad-8fb9-3436282ef933 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34e92ab-d0b1-485e-88ff-70563b7494fd req-b7b94719-59e2-42ad-8fb9-3436282ef933 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-f34e92ab-d0b1-485e-88ff-70563b7494fd req-b7b94719-59e2-42ad-8fb9-3436282ef933 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-330c9b41-e54a-463e-afa8-d021a11900bc for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 is timed out.
Nov 29 23:04:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Successfully detached device vdb from instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6 from the live domain config.
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjFCUBmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:38 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: INFO nova.compute.manager [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Terminating instance
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8291a9-716a-4e5b-a4f7-6b50f9ce42a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:38 user nova-compute[75244]: No targets found.
Nov 29 23:04:38 user nova-compute[75244]: iSNS:
Nov 29 23:04:38 user nova-compute[75244]: No targets found.
Nov 29 23:04:38 user nova-compute[75244]: STATIC:
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c
Nov 29 23:04:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:38 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:38 user nova-compute[75244]: No targets found.
Nov 29 23:04:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:38 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:38 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea24b36-f581-4001-ba6f-b6f16f08160c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ee630-62e8-4829-a0b2-14810e853de4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:38 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804747eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46'): ({'sdi'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Removing single pathed devices sdi {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c17883-b789-45f4-adef-fee6392f5077]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c201144-dfed-45bb-b819-e96e6895b5ab]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Flushing IO for device /dev/sdi {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0540300e-5f67-426f-acb5-dd37f3248ad4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-4a68f78c-9b92-444e-81b1-31b8e6bf0807 req-fd1eb232-f796-4570-8a64-0f910bb0ccbf service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4a68f78c-9b92-444e-81b1-31b8e6bf0807 req-fd1eb232-f796-4570-8a64-0f910bb0ccbf service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4a68f78c-9b92-444e-81b1-31b8e6bf0807 req-fd1eb232-f796-4570-8a64-0f910bb0ccbf service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4a68f78c-9b92-444e-81b1-31b8e6bf0807 req-fd1eb232-f796-4570-8a64-0f910bb0ccbf service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-4a68f78c-9b92-444e-81b1-31b8e6bf0807 req-fd1eb232-f796-4570-8a64-0f910bb0ccbf service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-4a68f78c-9b92-444e-81b1-31b8e6bf0807 req-fd1eb232-f796-4570-8a64-0f910bb0ccbf service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.065s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f61852-5569-4ce5-b248-8ed16ec236bd]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] SCSI volumes sdi have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a6226a-0bec-4b83-9a34-7d88c3b27a39]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1c88a2-dd59-43e6-b228-4a2660f76b79]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260]
Nov 29 23:04:39 user nova-compute[75244]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c2b167f-d93c-48be-95c4-3267b89a3e46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe7d07-4312-48c8-81cb-ccd3a0ce2a09]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] <== disconnect_volume: return (459ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Instance destroyed successfully.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lazy-loading 'resources' on Instance uuid 52205529-6ed5-42f2-b29d-88d4f4b1718e {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-735061721',display_name='tempest-AttachSCSIVolumeTestJSON-server-735061721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-735061721',id=7,image_ref='543f1b7d-e52f-42d9-b88e-57125f168056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvqbCuMOl76MHSgUKbG8YSy4MKvBXV48vOemvrxJA9ocN34QDMRpL/tnc0CAfc0uGidFU3w2gSL3G4Q1lpmZwqzbaEfYQjEObyEF+zl0baaL1eQra3Q27ip8/SRwfxEkA==',key_name='tempest-keypair-29109217',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15c46e81c7a049d5bf87280388a5eadb',ramdisk_id='',reservation_id='r-lrjtzb9g',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='543f1b7d-e52f-42d9-b88e-57125f168056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1007098860',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1007098860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='601ebd40a0dc49f4a1bebcfe1364ab03',uuid=52205529-6ed5-42f2-b29d-88d4f4b1718e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Converting VIF {"id": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "address": "fa:16:3e:ea:a6:d4", "network": {"id": "268ede54-3be2-4a62-955b-6ac42512442e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1265196453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15c46e81c7a049d5bf87280388a5eadb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3817c7-d4", "ovs_interfaceid": "2e3817c7-d46e-4da7-aecc-6ae6402a3be6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG os_vif [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e3817c7-d4, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31319e8b-783d-49d6-8fea-e9b2aeae978a) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: INFO os_vif [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:d4,bridge_name='br-int',has_traffic_filtering=True,id=2e3817c7-d46e-4da7-aecc-6ae6402a3be6,network=Network(268ede54-3be2-4a62-955b-6ac42512442e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e3817c7-d4')
Nov 29 23:04:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Deleting instance files /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e_del
Nov 29 23:04:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Deletion of /opt/stack/data/nova/instances/52205529-6ed5-42f2-b29d-88d4f4b1718e_del complete
Nov 29 23:04:40 user nova-compute[75244]: INFO nova.compute.manager [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Took 1.72 seconds to destroy the instance on the hypervisor.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lazy-loading 'flavor' on Instance uuid 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Instance destroyed successfully.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lazy-loading 'resources' on Instance uuid c8b888b3-9f53-4681-b46a-73b04625edd3 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap330c9b41-e5, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c1d2350c-8d5a-4c2f-8f42-1c802111a473 tempest-VolumesAssistedSnapshotsTest-351615032 tempest-VolumesAssistedSnapshotsTest-351615032-project-admin] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.379s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8ecae5d-5b24-4bf0-9290-fa3cde6eb17f) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: WARNING nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-330c9b41-e54a-463e-afa8-d021a11900bc for instance with vm_state active and task_state deleting.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: WARNING nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-fa1fc9cb-1778-4f37-9a12-3a91d8b9302f for instance with vm_state active and task_state deleting.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-b6c0109c-9e43-4883-87a0-a75f03fee286 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: WARNING nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-b6c0109c-9e43-4883-87a0-a75f03fee286 for instance with vm_state active and task_state deleting.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-f3582003-456d-4661-9129-95140451254b for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-f3582003-456d-4661-9129-95140451254b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: WARNING nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-f3582003-456d-4661-9129-95140451254b for instance with vm_state active and task_state deleting.
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-9dc491b3-a374-4c9b-b2f9-abc0bd42e3d7 req-4a1875a6-afea-4ebf-9ad0-88a4ed863372 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:6a:a3,bridge_name='br-int',has_traffic_filtering=True,id=330c9b41-e54a-463e-afa8-d021a11900bc,network=Network(b00b5396-6b5a-4a5a-a000-9df91fd4972d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap330c9b41-e5')
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa1fc9cb-17, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d740de56-9ecb-4f2c-836e-ad804a5854b3) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1c:c5,bridge_name='br-int',has_traffic_filtering=True,id=fa1fc9cb-1778-4f37-9a12-3a91d8b9302f,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa1fc9cb-17')
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6c0109c-9e, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7570d18d-9338-4294-a05b-40289d3b73ca) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:24:49,bridge_name='br-int',has_traffic_filtering=True,id=b6c0109c-9e43-4883-87a0-a75f03fee286,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6c0109c-9e')
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15f316a0-c3, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d451df9-353f-4bfe-97ac-fb61312ae1b3) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15f316a0-c3')
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3582003-45, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=389ee14d-7b35-4483-abac-906a3193e470) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:46:97,bridge_name='br-int',has_traffic_filtering=True,id=f3582003-456d-4661-9129-95140451254b,network=Network(16cd6577-bac1-45c3-b708-4c60642926b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3582003-45')
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "address": "fa:16:3e:5c:20:da", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362b04d-20", "ovs_interfaceid": "b362b04d-205d-4f80-9fe6-04d29ac24fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb362b04d-20, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b3b9951-2b8d-4346-b3db-ddfc76a1b15f) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:20:da,bridge_name='br-int',has_traffic_filtering=True,id=b362b04d-205d-4f80-9fe6-04d29ac24fc1,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb362b04d-20')
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-355562227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-355562227',id=10,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA89ugzeiUmCpxlVm1CCE4wQayXe8B48imCt5tuMowMrZwn156Bc1msUq4RolhEIkPEwm6K2jX2n6tie+3+djclW19x0EpzEiNZMtX3Ypr9FKsQ5es7RqJqpHviNnNA25Q==',key_name='tempest-keypair-263725302',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7769278e5e9f4143aa262b52dce8e991',ramdisk_id='',reservation_id='r-l8v373qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1071915267',owner_user_name='tempest-TaggedBootDevicesTest_v242-1071915267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5a33c7b60c142e3bd7ab47024678e62',uuid=c8b888b3-9f53-4681-b46a-73b04625edd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converting VIF {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b47ea01-93, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9556c3e2-985c-4f93-961a-a27aabb6b0b1) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:41 user nova-compute[75244]: INFO os_vif [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:32:bf,bridge_name='br-int',has_traffic_filtering=True,id=2b47ea01-93b6-4eca-bf6f-8898a1ce3583,network=Network(ca94698b-8968-4de4-b5ef-19e3520454a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b47ea01-93')
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeDCAopS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff9c103-a982-4067-8d46-160fe98f082a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:41 user nova-compute[75244]: No targets found.
Nov 29 23:04:41 user nova-compute[75244]: iSNS:
Nov 29 23:04:41 user nova-compute[75244]: No targets found.
Nov 29 23:04:41 user nova-compute[75244]: STATIC:
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:41 user nova-compute[75244]: No targets found.
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:41 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:41 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-ef87f17b-d6b9-4455-9748-6086826b6a42 req-f7630cfe-23f9-412f-baf7-086e51fa82c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ef87f17b-d6b9-4455-9748-6086826b6a42 req-f7630cfe-23f9-412f-baf7-086e51fa82c6 service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ef87f17b-d6b9-4455-9748-6086826b6a42 req-f7630cfe-23f9-412f-baf7-086e51fa82c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ef87f17b-d6b9-4455-9748-6086826b6a42 req-f7630cfe-23f9-412f-baf7-086e51fa82c6 service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-ef87f17b-d6b9-4455-9748-6086826b6a42 req-f7630cfe-23f9-412f-baf7-086e51fa82c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:41 user nova-compute[75244]: WARNING nova.compute.manager [req-ef87f17b-d6b9-4455-9748-6086826b6a42 req-f7630cfe-23f9-412f-baf7-086e51fa82c6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 for instance with vm_state active and task_state deleting.
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf63959-180b-48f3-aa74-375dfde7f23b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae05d319-bf74-4aa7-8a2b-e12295da4b9e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c1a8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b1b68-d0e6-499f-ac3a-d7af1d6d11ab]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f34c23-0be7-4df3-8b0d-b95811c85eb6]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefd230-21c3-479f-b192-3848c4a6a579]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.094s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da033c9-0c82-4755-a060-33205c30fdee]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d90cae-3c79-479d-83bf-be84ec6eae88]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaf590e-b8cd-4227-9ff0-13a99755411a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260]
Nov 29 23:04:41 user nova-compute[75244]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1adbe548-5aaf-4aff-96b5-d3b1d733a62c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5519a08-11b5-485e-92a4-a6a8af219db6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== disconnect_volume: return (378ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqBEhMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[26905e4b-6edd-4662-9d94-3611c58ee95e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:41 user nova-compute[75244]: No targets found.
Nov 29 23:04:41 user nova-compute[75244]: iSNS:
Nov 29 23:04:41 user nova-compute[75244]: No targets found.
Nov 29 23:04:41 user nova-compute[75244]: STATIC:
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc
Nov 29 23:04:41 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:41 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:41 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:41 user nova-compute[75244]: No targets found.
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:41 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:41 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb670b5-9d52-49a5-8463-cc89490fb64e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a5ca7-7d0f-4af9-bc7a-707cf0b2f305]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:41 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c0f32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d3581f-617e-4e51-9052-34dddd64570e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a0b8c7-0a88-4553-b593-94a21847a8e4]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e85fed-c6f6-457f-8946-547cbb76a8a6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd6967-ca44-4d6d-a489-691d8ebcc2b1]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe2915-bd75-4b87-ae4f-e1739164bd39]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Took 1.42 seconds to deallocate network for instance.
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9703ad-756c-45f5-8b63-9fb76a12a540]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260]
Nov 29 23:04:41 user nova-compute[75244]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb82e75-a465-47fd-95c3-5cbdb4d045cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c948d5b-7af3-4240-9ef6-5ae63dae3d95]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== disconnect_volume: return (313ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znosCRtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d4a98a-2cf5-47b8-b338-39cc87c97196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:42 user nova-compute[75244]: No targets found.
Nov 29 23:04:42 user nova-compute[75244]: iSNS:
Nov 29 23:04:42 user nova-compute[75244]: No targets found.
Nov 29 23:04:42 user nova-compute[75244]: STATIC:
Nov 29 23:04:42 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903
Nov 29 23:04:42 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:42 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:42 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:42 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:42 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:42 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:42 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:42 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:42 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:42 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:42 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:42 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:42 user nova-compute[75244]: No targets found.
Nov 29 23:04:42 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:42 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:42 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1c84ae-3403-4659-9a49-c78fc23471b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e1d20-459d-4979-83da-4757c3f2c431]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:42 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:42 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:42 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:42 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:42 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:42 user nova-compute[75244]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 (non-flash)
Nov 29 23:04:42 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:42 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804745d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5987a7-4908-4460-8405-1b34a582a1e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af90148-8cbf-411d-9b5e-3633417efda0]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f6fa7-2f0d-43c3-8c43-31597186867d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8645a6a-b6ff-4744-a782-7ec8605e488c]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f846aa11-b8d8-4a79-add5-2c9f95c6bfca]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0765089d-e7bb-427f-87d0-cca5b5307052]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260]
Nov 29 23:04:42 user nova-compute[75244]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:42 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e45ab9e7-7789-4395-a56f-4314bde0a903 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9479b52-7dde-4a2a-9a59-38569d6a31fd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] <== disconnect_volume: return (349ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Deleting instance files /opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3_del
Nov 29 23:04:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Deletion of /opt/stack/data/nova/instances/c8b888b3-9f53-4681-b46a-73b04625edd3_del complete
Nov 29 23:04:42 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Deleted allocations for instance 52205529-6ed5-42f2-b29d-88d4f4b1718e
Nov 29 23:04:42 user nova-compute[75244]: INFO nova.compute.manager [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Took 4.43 seconds to destroy the instance on the hypervisor.
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0aeb81f2-b877-4470-abe2-0816425b6e7b tempest-AttachSCSIVolumeTestJSON-1007098860 tempest-AttachSCSIVolumeTestJSON-1007098860-project-member] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.794s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:42 user nova-compute[75244]: WARNING nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-b362b04d-205d-4f80-9fe6-04d29ac24fc1 for instance with vm_state active and task_state deleting.
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-unplugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-unplugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Acquiring lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] No waiting events found dispatching network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:42 user nova-compute[75244]: WARNING nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received unexpected event network-vif-plugged-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 for instance with vm_state active and task_state deleting.
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-vif-unplugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] No waiting events found dispatching network-vif-unplugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:42 user nova-compute[75244]: WARNING nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received unexpected event network-vif-unplugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 for instance with vm_state deleted and task_state None.
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Acquiring lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] Lock "52205529-6ed5-42f2-b29d-88d4f4b1718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] No waiting events found dispatching network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:42 user nova-compute[75244]: WARNING nova.compute.manager [req-f633deff-4e18-4249-b857-99673c321b06 req-41d9a7ad-dd63-4a3c-9740-a28df327c5bd service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received unexpected event network-vif-plugged-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 for instance with vm_state deleted and task_state None.
Nov 29 23:04:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15', 'attached_at': '', 'detached_at': '', 'volume_id': '347cc3cd-92b8-445e-8f07-da56f58e129b', 'serial': '347cc3cd-92b8-445e-8f07-da56f58e129b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhovImxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '95e5c669-48fb-409e-8e88-813215c0eb5a'}, 'status': 'reserved', 'instance': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15', 'attached_at': '', 'detached_at': '', 'volume_id': '95e5c669-48fb-409e-8e88-813215c0eb5a', 'serial'} {{(pid=75244) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:43 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:43 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:43 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb43be-ae87-42b0-a1f3-c052cf09ce16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:04:43 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c63169f-92ef-4cbf-9a57-22e48db309e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b] added
Nov 29 23:04:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae049c-4ef3-4a2d-a15a-db281309a31d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a790268-2225-4fe6-b04f-6ca5e4446b24]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knIiAYRs {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knIiAYRs" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7821935-cf97-41d8-a0b6-aaf2d4c2fa31]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knIiAYRs'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d90a6c-4e1d-4e25-a558-97a2675497c1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b5f36-b75a-4500-8087-d39bc0cf4d64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-db451021-5e2a-49a4-8f9c-393aca385e63 req-d707b93a-f1a4-42a8-99b6-5c3989d902e1 service nova] [instance: 52205529-6ed5-42f2-b29d-88d4f4b1718e] Received event network-vif-deleted-2e3817c7-d46e-4da7-aecc-6ae6402a3be6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1dc45e-5175-404e-855d-c5ce851e8e00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]
Nov 29 23:04:43 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1818cf-0a93-454c-9c23-0ebbd5201826]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23a209-f708-4ce1-b158-f580ebe065c8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:43 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb24955-35dc-4e75-b4e8-ab7dbcceb2dc]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:04:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:04:44 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c is timed out.
Nov 29 23:04:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully detached device vdb from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the live domain config.
Nov 29 23:04:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePSGfHns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:44 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26232393165343437', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232393165343437', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.287s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG nova.objects.instance [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lazy-loading 'flavor' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb8b1c5-8c10-478a-88da-61ea413f3eea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:44 user nova-compute[75244]: No targets found.
Nov 29 23:04:44 user nova-compute[75244]: iSNS:
Nov 29 23:04:44 user nova-compute[75244]: No targets found.
Nov 29 23:04:44 user nova-compute[75244]: STATIC:
Nov 29 23:04:44 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366
Nov 29 23:04:44 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:44 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:44 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b
Nov 29 23:04:44 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:44 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:44 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:44 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:44 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:44 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:44 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:44 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:44 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:44 user nova-compute[75244]: No targets found.
Nov 29 23:04:44 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:44 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:44 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9313e32-e5be-4c06-9d72-99ce06360865]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d749cac-d626-4562-aafd-44b9d525b235]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:44 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:44 user nova-compute[75244]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:44 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:44 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 (non-flash)
Nov 29 23:04:44 user nova-compute[75244]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:44 user nova-compute[75244]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:44 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:44 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80438e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366'): ({'sdj'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Removing single pathed devices sdj {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b2c11-2ef3-49f2-b96d-8f5dae2d5f8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b8166-4aa8-41ca-97f1-f81281f8c7e8]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Flushing IO for device /dev/sdj {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f20301-04f0-49b4-a0b1-724fd79e1b7b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[deceab39-8e4d-4adc-8e05-13b47418c21b]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] SCSI volumes sdj have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7813fd-0dfd-4396-afb2-2538f5cbbb36]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4eb91-5b3a-4fd6-8559-3cb4292f6ba2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260]
Nov 29 23:04:44 user nova-compute[75244]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:44 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ac9111-8a67-43b4-9f25-13b9dcfd7366 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b85758-6af2-41d1-8580-3ba6e0a2002d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] <== disconnect_volume: return (655ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 98566144 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-deleted-b362b04d-205d-4f80-9fe6-04d29ac24fc1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:45 user nova-compute[75244]: INFO nova.compute.manager [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Neutron deleted interface b362b04d-205d-4f80-9fe6-04d29ac24fc1; detaching it from the instance and deleting it from the info cache
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.network.neutron [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "address": "fa:16:3e:73:62:f5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15f316a0-c3", "ovs_interfaceid": "15f316a0-c3f3-48f8-b8d4-2e025b8e11f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Detach interface failed, port_id=b362b04d-205d-4f80-9fe6-04d29ac24fc1, reason: Instance c8b888b3-9f53-4681-b46a-73b04625edd3 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-deleted-15f316a0-c3f3-48f8-b8d4-2e025b8e11f2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:45 user nova-compute[75244]: INFO nova.compute.manager [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Neutron deleted interface 15f316a0-c3f3-48f8-b8d4-2e025b8e11f2; detaching it from the instance and deleting it from the info cache
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.network.neutron [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [{"id": "330c9b41-e54a-463e-afa8-d021a11900bc", "address": "fa:16:3e:41:6a:a3", "network": {"id": "b00b5396-6b5a-4a5a-a000-9df91fd4972d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-748791517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap330c9b41-e5", "ovs_interfaceid": "330c9b41-e54a-463e-afa8-d021a11900bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "address": "fa:16:3e:ab:1c:c5", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1fc9cb-17", "ovs_interfaceid": "fa1fc9cb-1778-4f37-9a12-3a91d8b9302f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6c0109c-9e43-4883-87a0-a75f03fee286", "address": "fa:16:3e:dd:24:49", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c0109c-9e", "ovs_interfaceid": "b6c0109c-9e43-4883-87a0-a75f03fee286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3582003-456d-4661-9129-95140451254b", "address": "fa:16:3e:32:46:97", "network": {"id": "16cd6577-bac1-45c3-b708-4c60642926b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1751081006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3582003-45", "ovs_interfaceid": "f3582003-456d-4661-9129-95140451254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "address": "fa:16:3e:d7:32:bf", "network": {"id": "ca94698b-8968-4de4-b5ef-19e3520454a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-58964805", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7769278e5e9f4143aa262b52dce8e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b47ea01-93", "ovs_interfaceid": "2b47ea01-93b6-4eca-bf6f-8898a1ce3583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-04a8046d-276b-4b80-9110-44f66a7654fe req-32095639-a077-403a-a951-a7fd2306ab6f service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Detach interface failed, port_id=15f316a0-c3f3-48f8-b8d4-2e025b8e11f2, reason: Instance c8b888b3-9f53-4681-b46a-73b04625edd3 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:04:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 140509184 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'flavor' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-133b97c0-3307-4f77-9ff3-2abb1697bb15 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.453s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "interface-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-d5854fe0-5124-4447-a247-16563f42f3fa" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "interface-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-d5854fe0-5124-4447-a247-16563f42f3fa" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'flavor' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 222298112 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface> {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface> {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 23:04:46 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Took 3.96 seconds to deallocate network for instance.
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Attempting to detach device tapd5854fe0-51 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] detach device xml: <interface type="ethernet">
Nov 29 23:04:46 user nova-compute[75244]:   <mac address="fa:16:3e:73:82:e1"/>
Nov 29 23:04:46 user nova-compute[75244]:   <model type="virtio"/>
Nov 29 23:04:46 user nova-compute[75244]:   <mtu size="1442"/>
Nov 29 23:04:46 user nova-compute[75244]:   <target dev="tapd5854fe0-51"/>
Nov 29 23:04:46 user nova-compute[75244]: </interface>
Nov 29 23:04:46 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface> {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 23:04:46 user nova-compute[75244]:   <name>instance-00000006</name>
Nov 29 23:04:46 user nova-compute[75244]:   <uuid>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</uuid>
Nov 29 23:04:46 user nova-compute[75244]:   <metadata>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:04:46 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:04:46 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:04:46 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:04:04</nova:creationTime>
Nov 29 23:04:46 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:04:46 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:04:46 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:04:46 user nova-compute[75244]:   <nova:owner>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:04:46 user nova-compute[75244]:   </nova:owner>
Nov 29 23:04:46 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:04:46 user nova-compute[75244]:   <nova:ports>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:04:46 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:04:46 user nova-compute[75244]:     </nova:port>
Nov 29 23:04:46 user nova-compute[75244]:     <nova:port uuid="d5854fe0-5124-4447-a247-16563f42f3fa">
Nov 29 23:04:46 user nova-compute[75244]:       <nova:ip type="fixed" address="10.10.10.45" ipVersion="4"/>
Nov 29 23:04:46 user nova-compute[75244]:     </nova:port>
Nov 29 23:04:46 user nova-compute[75244]:   </nova:ports>
Nov 29 23:04:46 user nova-compute[75244]: </nova:instance>
Nov 29 23:04:46 user nova-compute[75244]:   </metadata>
Nov 29 23:04:46 user nova-compute[75244]:   <memory unit='KiB'>524288</memory>
Nov 29 23:04:46 user nova-compute[75244]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 23:04:46 user nova-compute[75244]:   <vcpu placement='static'>1</vcpu>
Nov 29 23:04:46 user nova-compute[75244]:   <resource>
Nov 29 23:04:46 user nova-compute[75244]:     <partition>/machine</partition>
Nov 29 23:04:46 user nova-compute[75244]:   </resource>
Nov 29 23:04:46 user nova-compute[75244]:   <sysinfo type='smbios'>
Nov 29 23:04:46 user nova-compute[75244]:     <system>
Nov 29 23:04:46 user nova-compute[75244]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 23:04:46 user nova-compute[75244]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 23:04:46 user nova-compute[75244]:       <entry name='version'>0.0.0</entry>
Nov 29 23:04:46 user nova-compute[75244]:       <entry name='serial'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:04:46 user nova-compute[75244]:       <entry name='uuid'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:04:46 user nova-compute[75244]:       <entry name='family'>Virtual Machine</entry>
Nov 29 23:04:46 user nova-compute[75244]:     </system>
Nov 29 23:04:46 user nova-compute[75244]:   </sysinfo>
Nov 29 23:04:46 user nova-compute[75244]:   <os>
Nov 29 23:04:46 user nova-compute[75244]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 23:04:46 user nova-compute[75244]:     <boot dev='hd'/>
Nov 29 23:04:46 user nova-compute[75244]:     <smbios mode='sysinfo'/>
Nov 29 23:04:46 user nova-compute[75244]:   </os>
Nov 29 23:04:46 user nova-compute[75244]:   <features>
Nov 29 23:04:46 user nova-compute[75244]:     <acpi/>
Nov 29 23:04:46 user nova-compute[75244]:     <apic/>
Nov 29 23:04:46 user nova-compute[75244]:     <vmcoreinfo state='on'/>
Nov 29 23:04:46 user nova-compute[75244]:   </features>
Nov 29 23:04:46 user nova-compute[75244]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 23:04:46 user nova-compute[75244]:     <model fallback='forbid'>Nehalem</model>
Nov 29 23:04:46 user nova-compute[75244]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 23:04:46 user nova-compute[75244]:     <feature policy='require' name='vme'/>
Nov 29 23:04:46 user nova-compute[75244]:     <feature policy='require' name='x2apic'/>
Nov 29 23:04:46 user nova-compute[75244]:     <feature policy='require' name='hypervisor'/>
Nov 29 23:04:46 user nova-compute[75244]:   </cpu>
Nov 29 23:04:46 user nova-compute[75244]:   <clock offset='utc'>
Nov 29 23:04:46 user nova-compute[75244]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 23:04:46 user nova-compute[75244]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 23:04:46 user nova-compute[75244]:     <timer name='hpet' present='no'/>
Nov 29 23:04:46 user nova-compute[75244]:   </clock>
Nov 29 23:04:46 user nova-compute[75244]:   <on_poweroff>destroy</on_poweroff>
Nov 29 23:04:46 user nova-compute[75244]:   <on_reboot>restart</on_reboot>
Nov 29 23:04:46 user nova-compute[75244]:   <on_crash>destroy</on_crash>
Nov 29 23:04:46 user nova-compute[75244]:   <devices>
Nov 29 23:04:46 user nova-compute[75244]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 23:04:46 user nova-compute[75244]:     <disk type='file' device='disk'>
Nov 29 23:04:46 user nova-compute[75244]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 23:04:46 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk' index='2'/>
Nov 29 23:04:46 user nova-compute[75244]:       <backingStore type='file' index='3'>
Nov 29 23:04:46 user nova-compute[75244]:         <format type='raw'/>
Nov 29 23:04:46 user nova-compute[75244]:         <source file='/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1'/>
Nov 29 23:04:46 user nova-compute[75244]:         <backingStore/>
Nov 29 23:04:46 user nova-compute[75244]:       </backingStore>
Nov 29 23:04:46 user nova-compute[75244]:       <target dev='vda' bus='virtio'/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='virtio-disk0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </disk>
Nov 29 23:04:46 user nova-compute[75244]:     <disk type='file' device='cdrom'>
Nov 29 23:04:46 user nova-compute[75244]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 23:04:46 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config' index='1'/>
Nov 29 23:04:46 user nova-compute[75244]:       <backingStore/>
Nov 29 23:04:46 user nova-compute[75244]:       <target dev='hda' bus='ide'/>
Nov 29 23:04:46 user nova-compute[75244]:       <readonly/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='ide0-0-0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </disk>
Nov 29 23:04:46 user nova-compute[75244]:     <controller type='usb' index='0' model='none'>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='usb'/>
Nov 29 23:04:46 user nova-compute[75244]:     </controller>
Nov 29 23:04:46 user nova-compute[75244]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='pci.0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </controller>
Nov 29 23:04:46 user nova-compute[75244]:     <controller type='ide' index='0'>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='ide'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 23:04:46 user nova-compute[75244]:     </controller>
Nov 29 23:04:46 user nova-compute[75244]:     <interface type='ethernet'>
Nov 29 23:04:46 user nova-compute[75244]:       <mac address='fa:16:3e:37:d9:57'/>
Nov 29 23:04:46 user nova-compute[75244]:       <target dev='tapdf674a1e-ea'/>
Nov 29 23:04:46 user nova-compute[75244]:       <model type='virtio'/>
Nov 29 23:04:46 user nova-compute[75244]:       <mtu size='1442'/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='net0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </interface>
Nov 29 23:04:46 user nova-compute[75244]:     <interface type='ethernet'>
Nov 29 23:04:46 user nova-compute[75244]:       <mac address='fa:16:3e:73:82:e1'/>
Nov 29 23:04:46 user nova-compute[75244]:       <target dev='tapd5854fe0-51'/>
Nov 29 23:04:46 user nova-compute[75244]:       <model type='virtio'/>
Nov 29 23:04:46 user nova-compute[75244]:       <mtu size='1442'/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='net1'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </interface>
Nov 29 23:04:46 user nova-compute[75244]:     <serial type='pty'>
Nov 29 23:04:46 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:04:46 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:04:46 user nova-compute[75244]:       <target type='isa-serial' port='0'>
Nov 29 23:04:46 user nova-compute[75244]:         <model name='isa-serial'/>
Nov 29 23:04:46 user nova-compute[75244]:       </target>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </serial>
Nov 29 23:04:46 user nova-compute[75244]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 23:04:46 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:04:46 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:04:46 user nova-compute[75244]:       <target type='serial' port='0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </console>
Nov 29 23:04:46 user nova-compute[75244]:     <input type='mouse' bus='ps2'>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='input0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </input>
Nov 29 23:04:46 user nova-compute[75244]:     <input type='keyboard' bus='ps2'>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='input1'/>
Nov 29 23:04:46 user nova-compute[75244]:     </input>
Nov 29 23:04:46 user nova-compute[75244]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 23:04:46 user nova-compute[75244]:       <listen type='address' address='0.0.0.0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </graphics>
Nov 29 23:04:46 user nova-compute[75244]:     <audio id='1' type='none'/>
Nov 29 23:04:46 user nova-compute[75244]:     <video>
Nov 29 23:04:46 user nova-compute[75244]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='video0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </video>
Nov 29 23:04:46 user nova-compute[75244]:     <memballoon model='virtio'>
Nov 29 23:04:46 user nova-compute[75244]:       <stats period='10'/>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='balloon0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </memballoon>
Nov 29 23:04:46 user nova-compute[75244]:     <rng model='virtio'>
Nov 29 23:04:46 user nova-compute[75244]:       <backend model='random'>/dev/urandom</backend>
Nov 29 23:04:46 user nova-compute[75244]:       <alias name='rng0'/>
Nov 29 23:04:46 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 23:04:46 user nova-compute[75244]:     </rng>
Nov 29 23:04:46 user nova-compute[75244]:   </devices>
Nov 29 23:04:46 user nova-compute[75244]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 23:04:46 user nova-compute[75244]:     <label>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</label>
Nov 29 23:04:46 user nova-compute[75244]:     <imagelabel>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</imagelabel>
Nov 29 23:04:46 user nova-compute[75244]:   </seclabel>
Nov 29 23:04:46 user nova-compute[75244]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 23:04:46 user nova-compute[75244]:     <label>+64055:+108</label>
Nov 29 23:04:46 user nova-compute[75244]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 23:04:46 user nova-compute[75244]:   </seclabel>
Nov 29 23:04:46 user nova-compute[75244]: </domain>
Nov 29 23:04:46 user nova-compute[75244]:  {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 23:04:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully detached device tapd5854fe0-51 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the persistent domain config.
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] (1/8): Attempting to detach device tapd5854fe0-51 with device alias net1 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] detach device xml: <interface type="ethernet">
Nov 29 23:04:46 user nova-compute[75244]:   <mac address="fa:16:3e:73:82:e1"/>
Nov 29 23:04:46 user nova-compute[75244]:   <model type="virtio"/>
Nov 29 23:04:46 user nova-compute[75244]:   <mtu size="1442"/>
Nov 29 23:04:46 user nova-compute[75244]:   <target dev="tapd5854fe0-51"/>
Nov 29 23:04:46 user nova-compute[75244]: </interface>
Nov 29 23:04:46 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Start waiting for the detach event from libvirt for device tapd5854fe0-51 with device alias net1 for instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-deleted-330c9b41-e54a-463e-afa8-d021a11900bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-deleted-2b47ea01-93b6-4eca-bf6f-8898a1ce3583 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Received event network-vif-deleted-f3582003-456d-4661-9129-95140451254b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-unplugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-unplugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:47 user nova-compute[75244]: WARNING nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-unplugged-d5854fe0-5124-4447-a247-16563f42f3fa for instance with vm_state active and task_state None.
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:47 user nova-compute[75244]: WARNING nova.compute.manager [req-849f30ba-7de1-4f63-a4e0-1e5bfe2714f8 req-6efc0a80-3a63-4fa6-86f8-c4cd3e91a6d6 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-plugged-d5854fe0-5124-4447-a247-16563f42f3fa for instance with vm_state active and task_state None.
Nov 29 23:04:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 578813952 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 692060160 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:04:49 user nova-compute[75244]: INFO nova.compute.claims [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Claim successful on node user
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 909115392 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:04:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.policy [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbdba67b1fdb470194c5a15ee3c4baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f830c5f8f3641f1938b103eae582ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:04:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Creating image(s)
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk 1073741824" returned: 0 in 0.054s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: INFO nova.compute.manager [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] [instance: c8b888b3-9f53-4681-b46a-73b04625edd3] Took 3.83 seconds to detach 3 volumes for instance.
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Cannot resize image /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Ensure instance console log exists: /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhovImxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '95e5c669-48fb-409e-8e88-813215c0eb5a'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:04:50 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e4a39-42f2-4178-a140-d4b36a8874a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:04:50 user nova-compute[75244]: No targets found.
Nov 29 23:04:50 user nova-compute[75244]: iSNS:
Nov 29 23:04:50 user nova-compute[75244]: No targets found.
Nov 29 23:04:50 user nova-compute[75244]: STATIC:
Nov 29 23:04:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b
Nov 29 23:04:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:04:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a
Nov 29 23:04:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:04:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:04:50 user nova-compute[75244]: FIRMWARE:
Nov 29 23:04:50 user nova-compute[75244]: No targets found.
Nov 29 23:04:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:04:50 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:04:50 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e5bfb-942c-4cd0-9c3f-5107d39b41bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd48af8-772e-454a-84b2-5bcbb45cfc58]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:50 user nova-compute[75244]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:50 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a (non-flash)
Nov 29 23:04:50 user nova-compute[75244]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:04:50 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:04:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8163dfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a'): ({'sdk'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Removing single pathed devices sdk {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc0bf0f-3ef9-4d74-a7d7-7c92c95cbb39]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9284b-0a71-4e25-b64b-642af4b2368d]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Flushing IO for device /dev/sdk {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[239a5add-54c7-4124-8410-68e6788d9fc2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:50 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Deleted allocations for instance c8b888b3-9f53-4681-b46a-73b04625edd3
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.049s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[21207ebb-6d2e-4563-ab97-30b84ddfd09f]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] SCSI volumes sdk have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c4bd89-db67-48a7-b4d1-5a06317af6e0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Successfully created port: 39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36cf9f6a-cf8f-46b1-ba47-ff5d4ab0ec70 tempest-TaggedBootDevicesTest_v242-1071915267 tempest-TaggedBootDevicesTest_v242-1071915267-project-member] Lock "c8b888b3-9f53-4681-b46a-73b04625edd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.898s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91d994-5b77-4e94-8745-bf9c1b243211]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260]
Nov 29 23:04:50 user nova-compute[75244]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a, portal: 172.16.0.220,3260] successful.
Nov 29 23:04:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e5c669-48fb-409e-8e88-813215c0eb5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29cf618-000e-4ba3-b1d9-99ddd7f93d1c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] <== disconnect_volume: return (306ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:04:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f0ba7f3a-d135-415c-a9dd-38c568e26e15', 'attached_at': '', 'detached_at': '', 'volume_id': '347cc3cd-92b8-445e-8f07-da56f58e129b', 'serial'} {{(pid=75244) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] swap_volume: removing Cinder connection for volume 95e5c669-48fb-409e-8e88-813215c0eb5a {{(pid=75244) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Successfully updated port: 39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquired lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-changed-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Refreshing instance network info cache due to event network-changed-39466e90-10cb-4540-bd33-8ef69252ced7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] Acquiring lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] swap_volume: Updating volume 95e5c669-48fb-409e-8e88-813215c0eb5a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "knIiAYRs", "auth_password": "gLuKDfAJ6XyFM5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "347cc3cd-92b8-445e-8f07-da56f58e129b"}, "status": "reserved", "instance": "f0ba7f3a-d135-415c-a9dd-38c568e26e15", "attached_at": "", "detached_at": "", "volume_id": "347cc3cd-92b8-445e-8f07-da56f58e129b", "serial": "347cc3cd-92b8-445e-8f07-da56f58e129b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '347cc3cd-92b8-445e-8f07-da56f58e129b', 'no_device': None, 'attachment_id': 'b81507b3-308b-4f16-aca1-c17b4508cba4'} {{(pid=75244) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating instance_info_cache with network_info: [{"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-91ec454a-a36e-47d1-8569-047e7d1717a0 tempest-TestVolumeSwap-791612812 tempest-TestVolumeSwap-791612812-project-admin] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.332s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Releasing lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Instance network_info: |[{"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] Acquired lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Refreshing network info cache for port 39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Start _get_guest_xml network_info=[{"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:04:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:04:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-923946142',display_name='tempest-AttachVolumeNegativeTest-server-923946142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-923946142',id=14,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI0lmtRFkyeAI/gt1RmsEp9wYbuwZnAR1XBqpvtkhLgJcyhgm9isfxnIsx10vOlSO8rbApqR1gAsUgTUINyEFg84wWaEc/aRTjrFbKgU472DWPHps4gHQC16sKnfnEGxQ==',key_name='tempest-keypair-1382844026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-65inmqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=b8ceea92-f765-46a7-8851-3bdacb386732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'pci_devices' on Instance uuid b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:04:51 user nova-compute[75244]:   <uuid>b8ceea92-f765-46a7-8851-3bdacb386732</uuid>
Nov 29 23:04:51 user nova-compute[75244]:   <name>instance-0000000e</name>
Nov 29 23:04:51 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:04:51 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:04:51 user nova-compute[75244]:   <metadata>
Nov 29 23:04:51 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:04:51 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:04:51 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeNegativeTest-server-923946142</nova:name>
Nov 29 23:04:51 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:04:51</nova:creationTime>
Nov 29 23:04:51 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:04:51 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:04:51 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:04:51 user nova-compute[75244]:       <nova:owner>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:user uuid="dbdba67b1fdb470194c5a15ee3c4baee">tempest-AttachVolumeNegativeTest-750809743-project-member</nova:user>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:project uuid="2f830c5f8f3641f1938b103eae582ccd">tempest-AttachVolumeNegativeTest-750809743</nova:project>
Nov 29 23:04:51 user nova-compute[75244]:       </nova:owner>
Nov 29 23:04:51 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:04:51 user nova-compute[75244]:       <nova:ports>
Nov 29 23:04:51 user nova-compute[75244]:         <nova:port uuid="39466e90-10cb-4540-bd33-8ef69252ced7">
Nov 29 23:04:51 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:04:51 user nova-compute[75244]:         </nova:port>
Nov 29 23:04:51 user nova-compute[75244]:       </nova:ports>
Nov 29 23:04:51 user nova-compute[75244]:     </nova:instance>
Nov 29 23:04:51 user nova-compute[75244]:   </metadata>
Nov 29 23:04:51 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:04:51 user nova-compute[75244]:     <system>
Nov 29 23:04:51 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:04:51 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:04:51 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:04:51 user nova-compute[75244]:       <entry name="serial">b8ceea92-f765-46a7-8851-3bdacb386732</entry>
Nov 29 23:04:51 user nova-compute[75244]:       <entry name="uuid">b8ceea92-f765-46a7-8851-3bdacb386732</entry>
Nov 29 23:04:51 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:04:51 user nova-compute[75244]:     </system>
Nov 29 23:04:51 user nova-compute[75244]:   </sysinfo>
Nov 29 23:04:51 user nova-compute[75244]:   <os>
Nov 29 23:04:51 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:04:51 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:04:51 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:04:51 user nova-compute[75244]:   </os>
Nov 29 23:04:51 user nova-compute[75244]:   <features>
Nov 29 23:04:51 user nova-compute[75244]:     <acpi/>
Nov 29 23:04:51 user nova-compute[75244]:     <apic/>
Nov 29 23:04:51 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:04:51 user nova-compute[75244]:   </features>
Nov 29 23:04:51 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:04:51 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:04:51 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:04:51 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:04:51 user nova-compute[75244]:   </clock>
Nov 29 23:04:51 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:04:51 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:04:51 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:04:51 user nova-compute[75244]:   </cpu>
Nov 29 23:04:51 user nova-compute[75244]:   <devices>
Nov 29 23:04:51 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:04:51 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:04:51 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk"/>
Nov 29 23:04:51 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:04:51 user nova-compute[75244]:     </disk>
Nov 29 23:04:51 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:04:51 user nova-compute[75244]:       <mac address="fa:16:3e:e8:44:ef"/>
Nov 29 23:04:51 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:04:51 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:04:51 user nova-compute[75244]:       <target dev="tap39466e90-10"/>
Nov 29 23:04:51 user nova-compute[75244]:     </interface>
Nov 29 23:04:51 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:04:51 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/console.log" append="off"/>
Nov 29 23:04:51 user nova-compute[75244]:     </serial>
Nov 29 23:04:51 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:04:51 user nova-compute[75244]:     <video>
Nov 29 23:04:51 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:04:51 user nova-compute[75244]:     </video>
Nov 29 23:04:51 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:04:51 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:04:51 user nova-compute[75244]:     </rng>
Nov 29 23:04:51 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:04:51 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:04:51 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:04:51 user nova-compute[75244]:     </memballoon>
Nov 29 23:04:51 user nova-compute[75244]:   </devices>
Nov 29 23:04:51 user nova-compute[75244]: </domain>
Nov 29 23:04:51 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-923946142',display_name='tempest-AttachVolumeNegativeTest-server-923946142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-923946142',id=14,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI0lmtRFkyeAI/gt1RmsEp9wYbuwZnAR1XBqpvtkhLgJcyhgm9isfxnIsx10vOlSO8rbApqR1gAsUgTUINyEFg84wWaEc/aRTjrFbKgU472DWPHps4gHQC16sKnfnEGxQ==',key_name='tempest-keypair-1382844026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-65inmqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=b8ceea92-f765-46a7-8851-3bdacb386732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG os_vif [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '479ee511-4e88-5958-b3df-0ebd0720c280', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39466e90-10, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39466e90-10, col_values=(('qos', UUID('a10c0a0b-83ab-4ef9-8c7c-f8d9856cc8cd')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39466e90-10, col_values=(('external_ids', {'iface-id': '39466e90-10cb-4540-bd33-8ef69252ced7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:44:ef', 'vm-uuid': 'b8ceea92-f765-46a7-8851-3bdacb386732'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:51 user nova-compute[75244]: INFO os_vif [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10')
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:e8:44:ef, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updated VIF entry in instance network info cache for port 39466e90-10cb-4540-bd33-8ef69252ced7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating instance_info_cache with network_info: [{"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b20675ca-a19e-46cd-8ce1-8d1254dcd1bc req-95a9a6c6-370a-4a47-a003-6de60b548b6b service nova] Releasing lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:52 user nova-compute[75244]: INFO nova.compute.manager [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Detaching volume 347cc3cd-92b8-445e-8f07-da56f58e129b
Nov 29 23:04:52 user nova-compute[75244]: INFO nova.virt.block_device [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Attempting to driver detach volume 347cc3cd-92b8-445e-8f07-da56f58e129b from mountpoint /dev/vdb
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Attempting to detach device vdb from instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:52 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:04:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:52 user nova-compute[75244]:   <serial>347cc3cd-92b8-445e-8f07-da56f58e129b</serial>
Nov 29 23:04:52 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:04:52 user nova-compute[75244]: </disk>
Nov 29 23:04:52 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Successfully detached device vdb from instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 from the persistent domain config.
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:04:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:04:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:04:52 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:04:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:04:52 user nova-compute[75244]:   <serial>347cc3cd-92b8-445e-8f07-da56f58e129b</serial>
Nov 29 23:04:52 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:04:52 user nova-compute[75244]: </disk>
Nov 29 23:04:52 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-2b03c5a3-c270-4239-8489-01e0622135eb req-993f2156-a443-45c0-8bec-cb73109b219e service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b03c5a3-c270-4239-8489-01e0622135eb req-993f2156-a443-45c0-8bec-cb73109b219e service nova] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b03c5a3-c270-4239-8489-01e0622135eb req-993f2156-a443-45c0-8bec-cb73109b219e service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b03c5a3-c270-4239-8489-01e0622135eb req-993f2156-a443-45c0-8bec-cb73109b219e service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-2b03c5a3-c270-4239-8489-01e0622135eb req-993f2156-a443-45c0-8bec-cb73109b219e service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] No waiting events found dispatching network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:53 user nova-compute[75244]: WARNING nova.compute.manager [req-2b03c5a3-c270-4239-8489-01e0622135eb req-993f2156-a443-45c0-8bec-cb73109b219e service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received unexpected event network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 for instance with vm_state building and task_state spawning.
Nov 29 23:04:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:04:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Instance spawned successfully.
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:04:55 user nova-compute[75244]: INFO nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-49ab2193-09ac-48c9-a935-8f06c0ae5559 req-b2be0b2c-572f-46f0-9b59-45903bb172ad service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49ab2193-09ac-48c9-a935-8f06c0ae5559 req-b2be0b2c-572f-46f0-9b59-45903bb172ad service nova] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49ab2193-09ac-48c9-a935-8f06c0ae5559 req-b2be0b2c-572f-46f0-9b59-45903bb172ad service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49ab2193-09ac-48c9-a935-8f06c0ae5559 req-b2be0b2c-572f-46f0-9b59-45903bb172ad service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-49ab2193-09ac-48c9-a935-8f06c0ae5559 req-b2be0b2c-572f-46f0-9b59-45903bb172ad service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] No waiting events found dispatching network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:04:55 user nova-compute[75244]: WARNING nova.compute.manager [req-49ab2193-09ac-48c9-a935-8f06c0ae5559 req-b2be0b2c-572f-46f0-9b59-45903bb172ad service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received unexpected event network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 for instance with vm_state building and task_state spawning.
Nov 29 23:04:55 user nova-compute[75244]: INFO nova.compute.manager [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Took 6.86 seconds to build instance.
Nov 29 23:04:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8c84d1a0-7fab-43f0-b530-1dfd984aed14 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.992s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:04:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:04:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:04:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:04:59 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'flavor' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:00 user nova-compute[75244]: INFO nova.compute.manager [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Attaching volume 461de32b-485a-43f2-a2d3-75801f587a03 to /dev/vdb
Nov 29 23:05:00 user nova-compute[75244]: DEBUG os_brick.utils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f043a923-decd-42aa-bedc-7f9028500b94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad7f9d-a502-4294-a5d3-ce63fd7d42a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaef536-ad16-4ea7-ae87-abd020c2e7a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5009e12-1aca-497a-a24d-94d7e62d13ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:05:00 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:05:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[606cef0b-33be-44c4-b143-acbe0b15e2a4]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG os_brick.utils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:00 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating existing volume attachment record: 11746f58-4495-4186-9e1b-daefc88fcb82 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:05:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:05:05 user nova-compute[75244]: INFO nova.compute.claims [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Claim successful on node user
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:05:05 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.policy [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df0d594179f64f79b1b66cbeea8bac59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefa2f1cf1914faa9c73096e1cb1b8e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:05:05 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Creating image(s)
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "/opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "/opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk 1073741824" returned: 0 in 0.051s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Successfully created port: 5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Cannot resize image /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Ensure instance console log exists: /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:06 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Waiting for libvirt event about the detach of device tapd5854fe0-51 with device alias net1 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c is timed out.
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface> {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 23:05:06 user nova-compute[75244]:   <name>instance-00000006</name>
Nov 29 23:05:06 user nova-compute[75244]:   <uuid>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</uuid>
Nov 29 23:05:06 user nova-compute[75244]:   <metadata>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:06 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:04:04</nova:creationTime>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:05:06 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:06 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:owner>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:05:06 user nova-compute[75244]:   </nova:owner>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:ports>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:05:06 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:05:06 user nova-compute[75244]:     </nova:port>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:port uuid="d5854fe0-5124-4447-a247-16563f42f3fa">
Nov 29 23:05:06 user nova-compute[75244]:       <nova:ip type="fixed" address="10.10.10.45" ipVersion="4"/>
Nov 29 23:05:06 user nova-compute[75244]:     </nova:port>
Nov 29 23:05:06 user nova-compute[75244]:   </nova:ports>
Nov 29 23:05:06 user nova-compute[75244]: </nova:instance>
Nov 29 23:05:06 user nova-compute[75244]:   </metadata>
Nov 29 23:05:06 user nova-compute[75244]:   <memory unit='KiB'>524288</memory>
Nov 29 23:05:06 user nova-compute[75244]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 23:05:06 user nova-compute[75244]:   <vcpu placement='static'>1</vcpu>
Nov 29 23:05:06 user nova-compute[75244]:   <resource>
Nov 29 23:05:06 user nova-compute[75244]:     <partition>/machine</partition>
Nov 29 23:05:06 user nova-compute[75244]:   </resource>
Nov 29 23:05:06 user nova-compute[75244]:   <sysinfo type='smbios'>
Nov 29 23:05:06 user nova-compute[75244]:     <system>
Nov 29 23:05:06 user nova-compute[75244]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 23:05:06 user nova-compute[75244]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 23:05:06 user nova-compute[75244]:       <entry name='version'>0.0.0</entry>
Nov 29 23:05:06 user nova-compute[75244]:       <entry name='serial'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:05:06 user nova-compute[75244]:       <entry name='uuid'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:05:06 user nova-compute[75244]:       <entry name='family'>Virtual Machine</entry>
Nov 29 23:05:06 user nova-compute[75244]:     </system>
Nov 29 23:05:06 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:06 user nova-compute[75244]:   <os>
Nov 29 23:05:06 user nova-compute[75244]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 23:05:06 user nova-compute[75244]:     <boot dev='hd'/>
Nov 29 23:05:06 user nova-compute[75244]:     <smbios mode='sysinfo'/>
Nov 29 23:05:06 user nova-compute[75244]:   </os>
Nov 29 23:05:06 user nova-compute[75244]:   <features>
Nov 29 23:05:06 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:06 user nova-compute[75244]:     <apic/>
Nov 29 23:05:06 user nova-compute[75244]:     <vmcoreinfo state='on'/>
Nov 29 23:05:06 user nova-compute[75244]:   </features>
Nov 29 23:05:06 user nova-compute[75244]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 23:05:06 user nova-compute[75244]:     <model fallback='forbid'>Nehalem</model>
Nov 29 23:05:06 user nova-compute[75244]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 23:05:06 user nova-compute[75244]:     <feature policy='require' name='vme'/>
Nov 29 23:05:06 user nova-compute[75244]:     <feature policy='require' name='x2apic'/>
Nov 29 23:05:06 user nova-compute[75244]:     <feature policy='require' name='hypervisor'/>
Nov 29 23:05:06 user nova-compute[75244]:   </cpu>
Nov 29 23:05:06 user nova-compute[75244]:   <clock offset='utc'>
Nov 29 23:05:06 user nova-compute[75244]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 23:05:06 user nova-compute[75244]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 23:05:06 user nova-compute[75244]:     <timer name='hpet' present='no'/>
Nov 29 23:05:06 user nova-compute[75244]:   </clock>
Nov 29 23:05:06 user nova-compute[75244]:   <on_poweroff>destroy</on_poweroff>
Nov 29 23:05:06 user nova-compute[75244]:   <on_reboot>restart</on_reboot>
Nov 29 23:05:06 user nova-compute[75244]:   <on_crash>destroy</on_crash>
Nov 29 23:05:06 user nova-compute[75244]:   <devices>
Nov 29 23:05:06 user nova-compute[75244]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 23:05:06 user nova-compute[75244]:     <disk type='file' device='disk'>
Nov 29 23:05:06 user nova-compute[75244]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 23:05:06 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk' index='2'/>
Nov 29 23:05:06 user nova-compute[75244]:       <backingStore type='file' index='3'>
Nov 29 23:05:06 user nova-compute[75244]:         <format type='raw'/>
Nov 29 23:05:06 user nova-compute[75244]:         <source file='/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1'/>
Nov 29 23:05:06 user nova-compute[75244]:         <backingStore/>
Nov 29 23:05:06 user nova-compute[75244]:       </backingStore>
Nov 29 23:05:06 user nova-compute[75244]:       <target dev='vda' bus='virtio'/>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='virtio-disk0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </disk>
Nov 29 23:05:06 user nova-compute[75244]:     <disk type='file' device='cdrom'>
Nov 29 23:05:06 user nova-compute[75244]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 23:05:06 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config' index='1'/>
Nov 29 23:05:06 user nova-compute[75244]:       <backingStore/>
Nov 29 23:05:06 user nova-compute[75244]:       <target dev='hda' bus='ide'/>
Nov 29 23:05:06 user nova-compute[75244]:       <readonly/>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='ide0-0-0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </disk>
Nov 29 23:05:06 user nova-compute[75244]:     <controller type='usb' index='0' model='none'>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='usb'/>
Nov 29 23:05:06 user nova-compute[75244]:     </controller>
Nov 29 23:05:06 user nova-compute[75244]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='pci.0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </controller>
Nov 29 23:05:06 user nova-compute[75244]:     <controller type='ide' index='0'>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='ide'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 23:05:06 user nova-compute[75244]:     </controller>
Nov 29 23:05:06 user nova-compute[75244]:     <interface type='ethernet'>
Nov 29 23:05:06 user nova-compute[75244]:       <mac address='fa:16:3e:37:d9:57'/>
Nov 29 23:05:06 user nova-compute[75244]:       <target dev='tapdf674a1e-ea'/>
Nov 29 23:05:06 user nova-compute[75244]:       <model type='virtio'/>
Nov 29 23:05:06 user nova-compute[75244]:       <mtu size='1442'/>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='net0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </interface>
Nov 29 23:05:06 user nova-compute[75244]:     <serial type='pty'>
Nov 29 23:05:06 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:05:06 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:05:06 user nova-compute[75244]:       <target type='isa-serial' port='0'>
Nov 29 23:05:06 user nova-compute[75244]:         <model name='isa-serial'/>
Nov 29 23:05:06 user nova-compute[75244]:       </target>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </serial>
Nov 29 23:05:06 user nova-compute[75244]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 23:05:06 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:05:06 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:05:06 user nova-compute[75244]:       <target type='serial' port='0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </console>
Nov 29 23:05:06 user nova-compute[75244]:     <input type='mouse' bus='ps2'>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='input0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </input>
Nov 29 23:05:06 user nova-compute[75244]:     <input type='keyboard' bus='ps2'>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='input1'/>
Nov 29 23:05:06 user nova-compute[75244]:     </input>
Nov 29 23:05:06 user nova-compute[75244]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 23:05:06 user nova-compute[75244]:       <listen type='address' address='0.0.0.0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </graphics>
Nov 29 23:05:06 user nova-compute[75244]:     <audio id='1' type='none'/>
Nov 29 23:05:06 user nova-compute[75244]:     <video>
Nov 29 23:05:06 user nova-compute[75244]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='video0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </video>
Nov 29 23:05:06 user nova-compute[75244]:     <memballoon model='virtio'>
Nov 29 23:05:06 user nova-compute[75244]:       <stats period='10'/>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='balloon0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:06 user nova-compute[75244]:     <rng model='virtio'>
Nov 29 23:05:06 user nova-compute[75244]:       <backend model='random'>/dev/urandom</backend>
Nov 29 23:05:06 user nova-compute[75244]:       <alias name='rng0'/>
Nov 29 23:05:06 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 23:05:06 user nova-compute[75244]:     </rng>
Nov 29 23:05:06 user nova-compute[75244]:   </devices>
Nov 29 23:05:06 user nova-compute[75244]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 23:05:06 user nova-compute[75244]:     <label>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</label>
Nov 29 23:05:06 user nova-compute[75244]:     <imagelabel>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</imagelabel>
Nov 29 23:05:06 user nova-compute[75244]:   </seclabel>
Nov 29 23:05:06 user nova-compute[75244]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 23:05:06 user nova-compute[75244]:     <label>+64055:+108</label>
Nov 29 23:05:06 user nova-compute[75244]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 23:05:06 user nova-compute[75244]:   </seclabel>
Nov 29 23:05:06 user nova-compute[75244]: </domain>
Nov 29 23:05:06 user nova-compute[75244]:  {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 23:05:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully detached device tapd5854fe0-51 from instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c from the live domain config.
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG os_vif [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5854fe0-51, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbe22ef8-d1f6-4c79-acfa-bacbc3586d7e) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:06 user nova-compute[75244]: INFO os_vif [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51')
Nov 29 23:05:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:06 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:05:06</nova:creationTime>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:05:06 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:06 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:owner>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:05:06 user nova-compute[75244]:   </nova:owner>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:06 user nova-compute[75244]:   <nova:ports>
Nov 29 23:05:06 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:05:06 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:05:06 user nova-compute[75244]:     </nova:port>
Nov 29 23:05:06 user nova-compute[75244]:   </nova:ports>
Nov 29 23:05:06 user nova-compute[75244]: </nova:instance>
Nov 29 23:05:06 user nova-compute[75244]:  {{(pid=75244) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Successfully updated port: 5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "refresh_cache-9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquired lock "refresh_cache-9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-changed-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Refreshing instance network info cache due to event network-changed-5b708ed5-68c2-452f-9909-f2a3543cd16e. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] Acquiring lock "refresh_cache-9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Updating instance_info_cache with network_info: [{"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Releasing lock "refresh_cache-9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Instance network_info: |[{"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] Acquired lock "refresh_cache-9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Refreshing network info cache for port 5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Start _get_guest_xml network_info=[{"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:05:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1295376455',display_name='tempest-VolumesAdminNegativeTest-server-1295376455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1295376455',id=15,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa2f1cf1914faa9c73096e1cb1b8e9',ramdisk_id='',reservation_id='r-1z499nob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-778262822',owner_user_name='tempest-VolumesAdminNegativeTest-778262822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:05:06Z,user_data=None,user_id='df0d594179f64f79b1b66cbeea8bac59',uuid=9f153ee8-e8ab-4ea3-9dea-c8cc419956fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converting VIF {"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:05:07 user nova-compute[75244]:   <uuid>9f153ee8-e8ab-4ea3-9dea-c8cc419956fc</uuid>
Nov 29 23:05:07 user nova-compute[75244]:   <name>instance-0000000f</name>
Nov 29 23:05:07 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:05:07 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:05:07 user nova-compute[75244]:   <metadata>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:07 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:05:07 user nova-compute[75244]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1295376455</nova:name>
Nov 29 23:05:07 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:05:07</nova:creationTime>
Nov 29 23:05:07 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:05:07 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:07 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:05:07 user nova-compute[75244]:       <nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:user uuid="df0d594179f64f79b1b66cbeea8bac59">tempest-VolumesAdminNegativeTest-778262822-project-member</nova:user>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:project uuid="cefa2f1cf1914faa9c73096e1cb1b8e9">tempest-VolumesAdminNegativeTest-778262822</nova:project>
Nov 29 23:05:07 user nova-compute[75244]:       </nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:07 user nova-compute[75244]:       <nova:ports>
Nov 29 23:05:07 user nova-compute[75244]:         <nova:port uuid="5b708ed5-68c2-452f-9909-f2a3543cd16e">
Nov 29 23:05:07 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 23:05:07 user nova-compute[75244]:         </nova:port>
Nov 29 23:05:07 user nova-compute[75244]:       </nova:ports>
Nov 29 23:05:07 user nova-compute[75244]:     </nova:instance>
Nov 29 23:05:07 user nova-compute[75244]:   </metadata>
Nov 29 23:05:07 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:05:07 user nova-compute[75244]:     <system>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name="serial">9f153ee8-e8ab-4ea3-9dea-c8cc419956fc</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name="uuid">9f153ee8-e8ab-4ea3-9dea-c8cc419956fc</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:05:07 user nova-compute[75244]:     </system>
Nov 29 23:05:07 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:07 user nova-compute[75244]:   <os>
Nov 29 23:05:07 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:05:07 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:05:07 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:05:07 user nova-compute[75244]:   </os>
Nov 29 23:05:07 user nova-compute[75244]:   <features>
Nov 29 23:05:07 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:07 user nova-compute[75244]:     <apic/>
Nov 29 23:05:07 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:05:07 user nova-compute[75244]:   </features>
Nov 29 23:05:07 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:05:07 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:05:07 user nova-compute[75244]:   </clock>
Nov 29 23:05:07 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:05:07 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:05:07 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:05:07 user nova-compute[75244]:   </cpu>
Nov 29 23:05:07 user nova-compute[75244]:   <devices>
Nov 29 23:05:07 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:05:07 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:05:07 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk"/>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:05:07 user nova-compute[75244]:     </disk>
Nov 29 23:05:07 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:05:07 user nova-compute[75244]:       <mac address="fa:16:3e:a6:11:a1"/>
Nov 29 23:05:07 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:07 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev="tap5b708ed5-68"/>
Nov 29 23:05:07 user nova-compute[75244]:     </interface>
Nov 29 23:05:07 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:05:07 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/console.log" append="off"/>
Nov 29 23:05:07 user nova-compute[75244]:     </serial>
Nov 29 23:05:07 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:05:07 user nova-compute[75244]:     <video>
Nov 29 23:05:07 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:07 user nova-compute[75244]:     </video>
Nov 29 23:05:07 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:05:07 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:05:07 user nova-compute[75244]:     </rng>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:05:07 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:05:07 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:05:07 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:07 user nova-compute[75244]:   </devices>
Nov 29 23:05:07 user nova-compute[75244]: </domain>
Nov 29 23:05:07 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1295376455',display_name='tempest-VolumesAdminNegativeTest-server-1295376455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1295376455',id=15,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa2f1cf1914faa9c73096e1cb1b8e9',ramdisk_id='',reservation_id='r-1z499nob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-778262822',owner_user_name='tempest-VolumesAdminNegativeTest-778262822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:05:06Z,user_data=None,user_id='df0d594179f64f79b1b66cbeea8bac59',uuid=9f153ee8-e8ab-4ea3-9dea-c8cc419956fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converting VIF {"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG os_vif [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a292777e-a7fb-542f-934e-71cd13d0119f', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b708ed5-68, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b708ed5-68, col_values=(('qos', UUID('5e848233-5584-4ec5-be15-f312923e732b')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b708ed5-68, col_values=(('external_ids', {'iface-id': '5b708ed5-68c2-452f-9909-f2a3543cd16e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:11:a1', 'vm-uuid': '9f153ee8-e8ab-4ea3-9dea-c8cc419956fc'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: INFO os_vif [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68')
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-deleted-d5854fe0-5124-4447-a247-16563f42f3fa {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:07 user nova-compute[75244]: INFO nova.compute.manager [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Neutron deleted interface d5854fe0-5124-4447-a247-16563f42f3fa; detaching it from the instance and deleting it from the info cache
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquired lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.objects.instance [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Lazy-loading 'system_metadata' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] No VIF found with MAC fa:16:3e:a6:11:a1, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.objects.instance [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Lazy-loading 'flavor' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.objects.base [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Object Instance<c81a4813-3b3c-4bf1-a3fe-d623aab59a1c> lazy-loaded attributes: system_metadata,flavor {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Converting VIF {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface> {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 23:05:07 user nova-compute[75244]:   <name>instance-00000006</name>
Nov 29 23:05:07 user nova-compute[75244]:   <uuid>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</uuid>
Nov 29 23:05:07 user nova-compute[75244]:   <metadata>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:07 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:05:06</nova:creationTime>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:05:07 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:ports>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:05:07 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:05:07 user nova-compute[75244]:     </nova:port>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:ports>
Nov 29 23:05:07 user nova-compute[75244]: </nova:instance>
Nov 29 23:05:07 user nova-compute[75244]:   </metadata>
Nov 29 23:05:07 user nova-compute[75244]:   <memory unit='KiB'>524288</memory>
Nov 29 23:05:07 user nova-compute[75244]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 23:05:07 user nova-compute[75244]:   <vcpu placement='static'>1</vcpu>
Nov 29 23:05:07 user nova-compute[75244]:   <resource>
Nov 29 23:05:07 user nova-compute[75244]:     <partition>/machine</partition>
Nov 29 23:05:07 user nova-compute[75244]:   </resource>
Nov 29 23:05:07 user nova-compute[75244]:   <sysinfo type='smbios'>
Nov 29 23:05:07 user nova-compute[75244]:     <system>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='version'>0.0.0</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='serial'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='uuid'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='family'>Virtual Machine</entry>
Nov 29 23:05:07 user nova-compute[75244]:     </system>
Nov 29 23:05:07 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:07 user nova-compute[75244]:   <os>
Nov 29 23:05:07 user nova-compute[75244]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 23:05:07 user nova-compute[75244]:     <boot dev='hd'/>
Nov 29 23:05:07 user nova-compute[75244]:     <smbios mode='sysinfo'/>
Nov 29 23:05:07 user nova-compute[75244]:   </os>
Nov 29 23:05:07 user nova-compute[75244]:   <features>
Nov 29 23:05:07 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:07 user nova-compute[75244]:     <apic/>
Nov 29 23:05:07 user nova-compute[75244]:     <vmcoreinfo state='on'/>
Nov 29 23:05:07 user nova-compute[75244]:   </features>
Nov 29 23:05:07 user nova-compute[75244]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 23:05:07 user nova-compute[75244]:     <model fallback='forbid'>Nehalem</model>
Nov 29 23:05:07 user nova-compute[75244]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 23:05:07 user nova-compute[75244]:     <feature policy='require' name='vme'/>
Nov 29 23:05:07 user nova-compute[75244]:     <feature policy='require' name='x2apic'/>
Nov 29 23:05:07 user nova-compute[75244]:     <feature policy='require' name='hypervisor'/>
Nov 29 23:05:07 user nova-compute[75244]:   </cpu>
Nov 29 23:05:07 user nova-compute[75244]:   <clock offset='utc'>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name='hpet' present='no'/>
Nov 29 23:05:07 user nova-compute[75244]:   </clock>
Nov 29 23:05:07 user nova-compute[75244]:   <on_poweroff>destroy</on_poweroff>
Nov 29 23:05:07 user nova-compute[75244]:   <on_reboot>restart</on_reboot>
Nov 29 23:05:07 user nova-compute[75244]:   <on_crash>destroy</on_crash>
Nov 29 23:05:07 user nova-compute[75244]:   <devices>
Nov 29 23:05:07 user nova-compute[75244]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 23:05:07 user nova-compute[75244]:     <disk type='file' device='disk'>
Nov 29 23:05:07 user nova-compute[75244]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 23:05:07 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk' index='2'/>
Nov 29 23:05:07 user nova-compute[75244]:       <backingStore type='file' index='3'>
Nov 29 23:05:07 user nova-compute[75244]:         <format type='raw'/>
Nov 29 23:05:07 user nova-compute[75244]:         <source file='/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1'/>
Nov 29 23:05:07 user nova-compute[75244]:         <backingStore/>
Nov 29 23:05:07 user nova-compute[75244]:       </backingStore>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev='vda' bus='virtio'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='virtio-disk0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </disk>
Nov 29 23:05:07 user nova-compute[75244]:     <disk type='file' device='cdrom'>
Nov 29 23:05:07 user nova-compute[75244]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 23:05:07 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config' index='1'/>
Nov 29 23:05:07 user nova-compute[75244]:       <backingStore/>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev='hda' bus='ide'/>
Nov 29 23:05:07 user nova-compute[75244]:       <readonly/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='ide0-0-0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </disk>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type='usb' index='0' model='none'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='usb'/>
Nov 29 23:05:07 user nova-compute[75244]:     </controller>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='pci.0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </controller>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type='ide' index='0'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='ide'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 23:05:07 user nova-compute[75244]:     </controller>
Nov 29 23:05:07 user nova-compute[75244]:     <interface type='ethernet'>
Nov 29 23:05:07 user nova-compute[75244]:       <mac address='fa:16:3e:37:d9:57'/>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev='tapdf674a1e-ea'/>
Nov 29 23:05:07 user nova-compute[75244]:       <model type='virtio'/>
Nov 29 23:05:07 user nova-compute[75244]:       <mtu size='1442'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='net0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </interface>
Nov 29 23:05:07 user nova-compute[75244]:     <serial type='pty'>
Nov 29 23:05:07 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:05:07 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:05:07 user nova-compute[75244]:       <target type='isa-serial' port='0'>
Nov 29 23:05:07 user nova-compute[75244]:         <model name='isa-serial'/>
Nov 29 23:05:07 user nova-compute[75244]:       </target>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </serial>
Nov 29 23:05:07 user nova-compute[75244]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 23:05:07 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:05:07 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:05:07 user nova-compute[75244]:       <target type='serial' port='0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </console>
Nov 29 23:05:07 user nova-compute[75244]:     <input type='mouse' bus='ps2'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='input0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </input>
Nov 29 23:05:07 user nova-compute[75244]:     <input type='keyboard' bus='ps2'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='input1'/>
Nov 29 23:05:07 user nova-compute[75244]:     </input>
Nov 29 23:05:07 user nova-compute[75244]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 23:05:07 user nova-compute[75244]:       <listen type='address' address='0.0.0.0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </graphics>
Nov 29 23:05:07 user nova-compute[75244]:     <audio id='1' type='none'/>
Nov 29 23:05:07 user nova-compute[75244]:     <video>
Nov 29 23:05:07 user nova-compute[75244]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='video0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </video>
Nov 29 23:05:07 user nova-compute[75244]:     <memballoon model='virtio'>
Nov 29 23:05:07 user nova-compute[75244]:       <stats period='10'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='balloon0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:07 user nova-compute[75244]:     <rng model='virtio'>
Nov 29 23:05:07 user nova-compute[75244]:       <backend model='random'>/dev/urandom</backend>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='rng0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </rng>
Nov 29 23:05:07 user nova-compute[75244]:   </devices>
Nov 29 23:05:07 user nova-compute[75244]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 23:05:07 user nova-compute[75244]:     <label>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</label>
Nov 29 23:05:07 user nova-compute[75244]:     <imagelabel>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</imagelabel>
Nov 29 23:05:07 user nova-compute[75244]:   </seclabel>
Nov 29 23:05:07 user nova-compute[75244]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 23:05:07 user nova-compute[75244]:     <label>+64055:+108</label>
Nov 29 23:05:07 user nova-compute[75244]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 23:05:07 user nova-compute[75244]:   </seclabel>
Nov 29 23:05:07 user nova-compute[75244]: </domain>
Nov 29 23:05:07 user nova-compute[75244]:  {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface> {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:73:82:e1"/><model type="virtio"/><mtu size="1442"/><target dev="tapd5854fe0-51"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 23:05:07 user nova-compute[75244]:   <name>instance-00000006</name>
Nov 29 23:05:07 user nova-compute[75244]:   <uuid>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</uuid>
Nov 29 23:05:07 user nova-compute[75244]:   <metadata>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:07 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:05:06</nova:creationTime>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:05:07 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:ports>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:05:07 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:05:07 user nova-compute[75244]:     </nova:port>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:ports>
Nov 29 23:05:07 user nova-compute[75244]: </nova:instance>
Nov 29 23:05:07 user nova-compute[75244]:   </metadata>
Nov 29 23:05:07 user nova-compute[75244]:   <memory unit='KiB'>524288</memory>
Nov 29 23:05:07 user nova-compute[75244]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 23:05:07 user nova-compute[75244]:   <vcpu placement='static'>1</vcpu>
Nov 29 23:05:07 user nova-compute[75244]:   <resource>
Nov 29 23:05:07 user nova-compute[75244]:     <partition>/machine</partition>
Nov 29 23:05:07 user nova-compute[75244]:   </resource>
Nov 29 23:05:07 user nova-compute[75244]:   <sysinfo type='smbios'>
Nov 29 23:05:07 user nova-compute[75244]:     <system>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='version'>0.0.0</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='serial'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='uuid'>c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</entry>
Nov 29 23:05:07 user nova-compute[75244]:       <entry name='family'>Virtual Machine</entry>
Nov 29 23:05:07 user nova-compute[75244]:     </system>
Nov 29 23:05:07 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:07 user nova-compute[75244]:   <os>
Nov 29 23:05:07 user nova-compute[75244]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 23:05:07 user nova-compute[75244]:     <boot dev='hd'/>
Nov 29 23:05:07 user nova-compute[75244]:     <smbios mode='sysinfo'/>
Nov 29 23:05:07 user nova-compute[75244]:   </os>
Nov 29 23:05:07 user nova-compute[75244]:   <features>
Nov 29 23:05:07 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:07 user nova-compute[75244]:     <apic/>
Nov 29 23:05:07 user nova-compute[75244]:     <vmcoreinfo state='on'/>
Nov 29 23:05:07 user nova-compute[75244]:   </features>
Nov 29 23:05:07 user nova-compute[75244]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 23:05:07 user nova-compute[75244]:     <model fallback='forbid'>Nehalem</model>
Nov 29 23:05:07 user nova-compute[75244]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 23:05:07 user nova-compute[75244]:     <feature policy='require' name='vme'/>
Nov 29 23:05:07 user nova-compute[75244]:     <feature policy='require' name='x2apic'/>
Nov 29 23:05:07 user nova-compute[75244]:     <feature policy='require' name='hypervisor'/>
Nov 29 23:05:07 user nova-compute[75244]:   </cpu>
Nov 29 23:05:07 user nova-compute[75244]:   <clock offset='utc'>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 23:05:07 user nova-compute[75244]:     <timer name='hpet' present='no'/>
Nov 29 23:05:07 user nova-compute[75244]:   </clock>
Nov 29 23:05:07 user nova-compute[75244]:   <on_poweroff>destroy</on_poweroff>
Nov 29 23:05:07 user nova-compute[75244]:   <on_reboot>restart</on_reboot>
Nov 29 23:05:07 user nova-compute[75244]:   <on_crash>destroy</on_crash>
Nov 29 23:05:07 user nova-compute[75244]:   <devices>
Nov 29 23:05:07 user nova-compute[75244]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 23:05:07 user nova-compute[75244]:     <disk type='file' device='disk'>
Nov 29 23:05:07 user nova-compute[75244]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 23:05:07 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk' index='2'/>
Nov 29 23:05:07 user nova-compute[75244]:       <backingStore type='file' index='3'>
Nov 29 23:05:07 user nova-compute[75244]:         <format type='raw'/>
Nov 29 23:05:07 user nova-compute[75244]:         <source file='/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1'/>
Nov 29 23:05:07 user nova-compute[75244]:         <backingStore/>
Nov 29 23:05:07 user nova-compute[75244]:       </backingStore>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev='vda' bus='virtio'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='virtio-disk0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </disk>
Nov 29 23:05:07 user nova-compute[75244]:     <disk type='file' device='cdrom'>
Nov 29 23:05:07 user nova-compute[75244]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 23:05:07 user nova-compute[75244]:       <source file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk.config' index='1'/>
Nov 29 23:05:07 user nova-compute[75244]:       <backingStore/>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev='hda' bus='ide'/>
Nov 29 23:05:07 user nova-compute[75244]:       <readonly/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='ide0-0-0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </disk>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type='usb' index='0' model='none'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='usb'/>
Nov 29 23:05:07 user nova-compute[75244]:     </controller>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='pci.0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </controller>
Nov 29 23:05:07 user nova-compute[75244]:     <controller type='ide' index='0'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='ide'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 23:05:07 user nova-compute[75244]:     </controller>
Nov 29 23:05:07 user nova-compute[75244]:     <interface type='ethernet'>
Nov 29 23:05:07 user nova-compute[75244]:       <mac address='fa:16:3e:37:d9:57'/>
Nov 29 23:05:07 user nova-compute[75244]:       <target dev='tapdf674a1e-ea'/>
Nov 29 23:05:07 user nova-compute[75244]:       <model type='virtio'/>
Nov 29 23:05:07 user nova-compute[75244]:       <mtu size='1442'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='net0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </interface>
Nov 29 23:05:07 user nova-compute[75244]:     <serial type='pty'>
Nov 29 23:05:07 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:05:07 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:05:07 user nova-compute[75244]:       <target type='isa-serial' port='0'>
Nov 29 23:05:07 user nova-compute[75244]:         <model name='isa-serial'/>
Nov 29 23:05:07 user nova-compute[75244]:       </target>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </serial>
Nov 29 23:05:07 user nova-compute[75244]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 23:05:07 user nova-compute[75244]:       <source path='/dev/pts/6'/>
Nov 29 23:05:07 user nova-compute[75244]:       <log file='/opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/console.log' append='off'/>
Nov 29 23:05:07 user nova-compute[75244]:       <target type='serial' port='0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='serial0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </console>
Nov 29 23:05:07 user nova-compute[75244]:     <input type='mouse' bus='ps2'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='input0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </input>
Nov 29 23:05:07 user nova-compute[75244]:     <input type='keyboard' bus='ps2'>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='input1'/>
Nov 29 23:05:07 user nova-compute[75244]:     </input>
Nov 29 23:05:07 user nova-compute[75244]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 23:05:07 user nova-compute[75244]:       <listen type='address' address='0.0.0.0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </graphics>
Nov 29 23:05:07 user nova-compute[75244]:     <audio id='1' type='none'/>
Nov 29 23:05:07 user nova-compute[75244]:     <video>
Nov 29 23:05:07 user nova-compute[75244]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='video0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </video>
Nov 29 23:05:07 user nova-compute[75244]:     <memballoon model='virtio'>
Nov 29 23:05:07 user nova-compute[75244]:       <stats period='10'/>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='balloon0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:07 user nova-compute[75244]:     <rng model='virtio'>
Nov 29 23:05:07 user nova-compute[75244]:       <backend model='random'>/dev/urandom</backend>
Nov 29 23:05:07 user nova-compute[75244]:       <alias name='rng0'/>
Nov 29 23:05:07 user nova-compute[75244]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 23:05:07 user nova-compute[75244]:     </rng>
Nov 29 23:05:07 user nova-compute[75244]:   </devices>
Nov 29 23:05:07 user nova-compute[75244]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 23:05:07 user nova-compute[75244]:     <label>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</label>
Nov 29 23:05:07 user nova-compute[75244]:     <imagelabel>libvirt-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c</imagelabel>
Nov 29 23:05:07 user nova-compute[75244]:   </seclabel>
Nov 29 23:05:07 user nova-compute[75244]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 23:05:07 user nova-compute[75244]:     <label>+64055:+108</label>
Nov 29 23:05:07 user nova-compute[75244]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 23:05:07 user nova-compute[75244]:   </seclabel>
Nov 29 23:05:07 user nova-compute[75244]: </domain>
Nov 29 23:05:07 user nova-compute[75244]:  {{(pid=75244) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 23:05:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Detaching interface fa:16:3e:73:82:e1 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapd5854fe0-51' not found.
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Converting VIF {"id": "d5854fe0-5124-4447-a247-16563f42f3fa", "address": "fa:16:3e:73:82:e1", "network": {"id": "2cff97f6-c8bc-41d3-a6ad-498ece540aec", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1176964985", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5854fe0-51", "ovs_interfaceid": "d5854fe0-5124-4447-a247-16563f42f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG os_vif [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5854fe0-51, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:05:07 user nova-compute[75244]: INFO os_vif [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:e1,bridge_name='br-int',has_traffic_filtering=True,id=d5854fe0-5124-4447-a247-16563f42f3fa,network=Network(2cff97f6-c8bc-41d3-a6ad-498ece540aec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5854fe0-51')
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [req-eb69410c-bd91-41e3-9fc6-ea0c682fcb10 req-27f9c678-b0e0-459a-b9f2-90f12262be93 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:07 user nova-compute[75244]:   <nova:package version="0.0.0"/>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:name>tempest-device-tagging-server-262656022</nova:name>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:creationTime>2023-11-29 23:05:07</nova:creationTime>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:flavor name="m1.tiny">
Nov 29 23:05:07 user nova-compute[75244]:     <nova:memory>512</nova:memory>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:disk>1</nova:disk>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:swap>0</nova:swap>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:flavor>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:user uuid="1bfa897438554825be52e4c5c45ea3c0">tempest-TaggedAttachmentsTest-1155771791-project-member</nova:user>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:project uuid="f2123fd8af384a46bd4d6baee7f1583d">tempest-TaggedAttachmentsTest-1155771791</nova:project>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:owner>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:07 user nova-compute[75244]:   <nova:ports>
Nov 29 23:05:07 user nova-compute[75244]:     <nova:port uuid="df674a1e-ea01-45a5-8867-f3ce46592f03">
Nov 29 23:05:07 user nova-compute[75244]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 23:05:07 user nova-compute[75244]:     </nova:port>
Nov 29 23:05:07 user nova-compute[75244]:   </nova:ports>
Nov 29 23:05:07 user nova-compute[75244]: </nova:instance>
Nov 29 23:05:07 user nova-compute[75244]:  {{(pid=75244) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Updated VIF entry in instance network info cache for port 5b708ed5-68c2-452f-9909-f2a3543cd16e. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Updating instance_info_cache with network_info: [{"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2e48d660-01af-49f9-805f-212bffae22df req-a04170d9-5a61-497d-b37f-7688e394742a service nova] Releasing lock "refresh_cache-9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [{"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Releasing lock "refresh_cache-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-737e4654-95c9-440b-9c8d-fd40090f3a36 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "interface-c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-d5854fe0-5124-4447-a247-16563f42f3fa" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.117s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:08 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:08 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:08 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b1dcf-1194-41a8-b094-7c43f5b26c48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:05:08 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1202066-14ce-476d-ae1d-d94f3f58f37c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03] added
Nov 29 23:05:08 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f20b67-caf4-4269-a3d8-744dab2b3e01]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af0189-53a2-4db4-a558-6e397be33d52]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyebdYQD {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyebdYQD" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72f4c8-aa08-403d-91bb-318b7da7df5d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IyebdYQD'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeff473-0c1c-4c08-964c-74f8f3e35a1c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[804fc52d-bb0b-4a72-ba2e-21b1efa9af67]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:05:08 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:08 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:05:08 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:08 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c20259-019d-4665-be86-79394829adbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]
Nov 29 23:05:08 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:08 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ac6b0-87b5-44c2-b7b8-91f03d183773]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9195f2b-32cd-411b-88bb-9917219a10c2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:05:08 user nova-compute[75244]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:08 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:08 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:05:08 user nova-compute[75244]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:08 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:08 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[898c5e54-2b1d-4607-beec-695eb95a67c1]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:05:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-77e27954-6101-48f9-bd5d-aecd7053ee1e req-4239c2f6-cd5e-43f6-a4e7-1906acf8f1c0 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-77e27954-6101-48f9-bd5d-aecd7053ee1e req-4239c2f6-cd5e-43f6-a4e7-1906acf8f1c0 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-77e27954-6101-48f9-bd5d-aecd7053ee1e req-4239c2f6-cd5e-43f6-a4e7-1906acf8f1c0 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-77e27954-6101-48f9-bd5d-aecd7053ee1e req-4239c2f6-cd5e-43f6-a4e7-1906acf8f1c0 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-77e27954-6101-48f9-bd5d-aecd7053ee1e req-4239c2f6-cd5e-43f6-a4e7-1906acf8f1c0 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:09 user nova-compute[75244]: WARNING nova.compute.manager [req-77e27954-6101-48f9-bd5d-aecd7053ee1e req-4239c2f6-cd5e-43f6-a4e7-1906acf8f1c0 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received unexpected event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with vm_state building and task_state spawning.
Nov 29 23:05:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26663336333313266', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663336333313266', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'flavor' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:05:10 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:05:10 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:05:10 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:05:10 user nova-compute[75244]:   <serial>461de32b-485a-43f2-a2d3-75801f587a03</serial>
Nov 29 23:05:10 user nova-compute[75244]: </disk>
Nov 29 23:05:10 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No VIF found with MAC fa:16:3e:ff:ff:ed, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:05:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8f809891-6e82-4f53-b390-27a25abc4c60 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.481s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:05:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Instance spawned successfully.
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-f8920168-1304-41cc-bc34-b9b6bb3784da req-bbcd3bd0-1f8c-451f-aef7-a0990ce9140d service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8920168-1304-41cc-bc34-b9b6bb3784da req-bbcd3bd0-1f8c-451f-aef7-a0990ce9140d service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8920168-1304-41cc-bc34-b9b6bb3784da req-bbcd3bd0-1f8c-451f-aef7-a0990ce9140d service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8920168-1304-41cc-bc34-b9b6bb3784da req-bbcd3bd0-1f8c-451f-aef7-a0990ce9140d service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-f8920168-1304-41cc-bc34-b9b6bb3784da req-bbcd3bd0-1f8c-451f-aef7-a0990ce9140d service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:11 user nova-compute[75244]: WARNING nova.compute.manager [req-f8920168-1304-41cc-bc34-b9b6bb3784da req-bbcd3bd0-1f8c-451f-aef7-a0990ce9140d service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received unexpected event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with vm_state building and task_state spawning.
Nov 29 23:05:11 user nova-compute[75244]: INFO nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 29 23:05:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:05:11 user nova-compute[75244]: INFO nova.compute.manager [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Took 6.40 seconds to build instance.
Nov 29 23:05:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e40ddadf-faa4-4163-a565-27eb38f8dd96 tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.499s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:12 user nova-compute[75244]: INFO nova.compute.manager [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Terminating instance
Nov 29 23:05:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 is timed out.
Nov 29 23:05:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Successfully detached device vdb from instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 from the live domain config.
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knIiAYRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '347cc3cd-92b8-445e-8f07-da56f58e129b'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a3ca2-7371-42d1-b947-84d9acebc841]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:05:13 user nova-compute[75244]: No targets found.
Nov 29 23:05:13 user nova-compute[75244]: iSNS:
Nov 29 23:05:13 user nova-compute[75244]: No targets found.
Nov 29 23:05:13 user nova-compute[75244]: STATIC:
Nov 29 23:05:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b
Nov 29 23:05:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:05:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03
Nov 29 23:05:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:13 user nova-compute[75244]: FIRMWARE:
Nov 29 23:05:13 user nova-compute[75244]: No targets found.
Nov 29 23:05:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:05:13 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:05:13 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9fe386-f90a-4345-8a3c-afaf4cdcd10c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a2b4e-d4ce-4373-b44c-2e4b4523206e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:05:13 user nova-compute[75244]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:13 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b (non-flash)
Nov 29 23:05:13 user nova-compute[75244]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:13 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80438f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6befee1-6791-4aa8-9473-2ae495631d0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbba571-2076-4326-8603-eb263ba02229]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aa54e1-999c-4494-a03b-2b21d808297c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-e29bce86-84ec-4b50-a589-ce9ccf6d9936 req-6dc66574-7611-475d-aced-74e7d9ac4a51 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-vif-unplugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e29bce86-84ec-4b50-a589-ce9ccf6d9936 req-6dc66574-7611-475d-aced-74e7d9ac4a51 service nova] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e29bce86-84ec-4b50-a589-ce9ccf6d9936 req-6dc66574-7611-475d-aced-74e7d9ac4a51 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e29bce86-84ec-4b50-a589-ce9ccf6d9936 req-6dc66574-7611-475d-aced-74e7d9ac4a51 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-e29bce86-84ec-4b50-a589-ce9ccf6d9936 req-6dc66574-7611-475d-aced-74e7d9ac4a51 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] No waiting events found dispatching network-vif-unplugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-e29bce86-84ec-4b50-a589-ce9ccf6d9936 req-6dc66574-7611-475d-aced-74e7d9ac4a51 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-vif-unplugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[707376d8-a3a9-46e3-b4de-054cd24d72a8]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7707efa-fd91-432b-bb5e-018e6b94a504]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c50f82a-97f0-4f09-8bc7-35650a0a0cb3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260]
Nov 29 23:05:13 user nova-compute[75244]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:347cc3cd-92b8-445e-8f07-da56f58e129b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9977a26e-6db3-4495-86a3-3f127e729ba4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] <== disconnect_volume: return (350ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:05:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Instance destroyed successfully.
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lazy-loading 'resources' on Instance uuid 75dbc99c-86b4-408b-b35e-be8365c8fcf6 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1540542304',display_name='tempest-VolumesAssistedSnapshotsTest-server-1540542304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1540542304',id=9,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Q+7ybsmSnwf/ssdUZcvAa1Cj5w+vTXNluFaZgqVkbBtX1uKS3Qr4buQHE543ijAkRy21qa3y7JDWDOXmD8Pv+DNI7HuV7v1biNwLHLDmMtshscG6abWKRpSGOWto7HA==',key_name='tempest-keypair-2029322343',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d624dca89c97425e9abaf886236ab957',ramdisk_id='',reservation_id='r-wtj3mi15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1699476414',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1699476414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36c7a58e318d44c5b7ef12c5ecab830e',uuid=75dbc99c-86b4-408b-b35e-be8365c8fcf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Converting VIF {"id": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "address": "fa:16:3e:23:28:c0", "network": {"id": "65ecf646-6c06-4acc-8bb5-0efbe667ee26", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471608714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d624dca89c97425e9abaf886236ab957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7156989c-5e", "ovs_interfaceid": "7156989c-5e7f-44b1-986e-6a0e3b698c94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG os_vif [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7156989c-5e, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e4c8bff-0c5c-43c0-b849-5556cef42823) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:13 user nova-compute[75244]: INFO os_vif [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=7156989c-5e7f-44b1-986e-6a0e3b698c94,network=Network(65ecf646-6c06-4acc-8bb5-0efbe667ee26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7156989c-5e')
Nov 29 23:05:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Deleting instance files /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6_del
Nov 29 23:05:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Deletion of /opt/stack/data/nova/instances/75dbc99c-86b4-408b-b35e-be8365c8fcf6_del complete
Nov 29 23:05:13 user nova-compute[75244]: INFO nova.compute.manager [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 29 23:05:13 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:05:13 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:05:14 user nova-compute[75244]: DEBUG nova.objects.instance [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lazy-loading 'flavor' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fcd79a3d-3331-4ea0-abe0-990eb55ea39c tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.062s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:15 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Took 1.06 seconds to deallocate network for instance.
Nov 29 23:05:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-a581c06c-a7e3-4b31-8ab6-fea53ffce296 req-ae1971a7-97e9-4ba1-859f-1bee2bdbc00b service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-vif-deleted-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-d382018d-369b-4edd-8949-8d4e130e8ab6 req-54e5f962-d448-454d-bd80-198b9eb88428 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received event network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d382018d-369b-4edd-8949-8d4e130e8ab6 req-54e5f962-d448-454d-bd80-198b9eb88428 service nova] Acquiring lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d382018d-369b-4edd-8949-8d4e130e8ab6 req-54e5f962-d448-454d-bd80-198b9eb88428 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d382018d-369b-4edd-8949-8d4e130e8ab6 req-54e5f962-d448-454d-bd80-198b9eb88428 service nova] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-d382018d-369b-4edd-8949-8d4e130e8ab6 req-54e5f962-d448-454d-bd80-198b9eb88428 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] No waiting events found dispatching network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:15 user nova-compute[75244]: WARNING nova.compute.manager [req-d382018d-369b-4edd-8949-8d4e130e8ab6 req-54e5f962-d448-454d-bd80-198b9eb88428 service nova] [instance: 75dbc99c-86b4-408b-b35e-be8365c8fcf6] Received unexpected event network-vif-plugged-7156989c-5e7f-44b1-986e-6a0e3b698c94 for instance with vm_state deleted and task_state None.
Nov 29 23:05:15 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Deleted allocations for instance 75dbc99c-86b4-408b-b35e-be8365c8fcf6
Nov 29 23:05:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-201200d4-5605-4493-b0e9-1e67f8cef870 tempest-VolumesAssistedSnapshotsTest-1699476414 tempest-VolumesAssistedSnapshotsTest-1699476414-project-member] Lock "75dbc99c-86b4-408b-b35e-be8365c8fcf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.731s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "254dca38-2e6d-4303-86af-369275d7529f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:17 user nova-compute[75244]: INFO nova.compute.manager [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Terminating instance
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-319764a6-4bfb-41e6-ace2-01d5df7eb733 req-3cec7c61-fe90-4eb7-b385-3c1b2875daf2 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-vif-unplugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-319764a6-4bfb-41e6-ace2-01d5df7eb733 req-3cec7c61-fe90-4eb7-b385-3c1b2875daf2 service nova] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-319764a6-4bfb-41e6-ace2-01d5df7eb733 req-3cec7c61-fe90-4eb7-b385-3c1b2875daf2 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-319764a6-4bfb-41e6-ace2-01d5df7eb733 req-3cec7c61-fe90-4eb7-b385-3c1b2875daf2 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-319764a6-4bfb-41e6-ace2-01d5df7eb733 req-3cec7c61-fe90-4eb7-b385-3c1b2875daf2 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] No waiting events found dispatching network-vif-unplugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-319764a6-4bfb-41e6-ace2-01d5df7eb733 req-3cec7c61-fe90-4eb7-b385-3c1b2875daf2 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-vif-unplugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Instance destroyed successfully.
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lazy-loading 'resources' on Instance uuid 254dca38-2e6d-4303-86af-369275d7529f {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-293305103',display_name='tempest-ServersNegativeTestJSON-server-293305103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-293305103',id=12,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15889b42830c48049aa8537bd8e82d56',ramdisk_id='',reservation_id='r-u0o460uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1248877561',owner_user_name='tempest-ServersNegativeTestJSON-1248877561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:34Z,user_data=None,user_id='7f680496b0c147a48948cb1f24c65797',uuid=254dca38-2e6d-4303-86af-369275d7529f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converting VIF {"id": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "address": "fa:16:3e:43:60:b3", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfc38e7-ba", "ovs_interfaceid": "bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG os_vif [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcfc38e7-ba, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63056bc5-cf77-4dbb-901e-7d3fa053b0e3) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:17 user nova-compute[75244]: INFO os_vif [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:b3,bridge_name='br-int',has_traffic_filtering=True,id=bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfc38e7-ba')
Nov 29 23:05:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Deleting instance files /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f_del
Nov 29 23:05:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Deletion of /opt/stack/data/nova/instances/254dca38-2e6d-4303-86af-369275d7529f_del complete
Nov 29 23:05:17 user nova-compute[75244]: INFO nova.compute.manager [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 23:05:17 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:05:17 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 254dca38-2e6d-4303-86af-369275d7529f] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:05:18 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:18 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Took 0.49 seconds to deallocate network for instance.
Nov 29 23:05:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-e7e901af-4d70-4dc5-abb2-ed3ef14fd4fa req-d7624471-2444-44ff-89a9-af178f17f4d6 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-vif-deleted-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:18 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:18 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:18 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Deleted allocations for instance 254dca38-2e6d-4303-86af-369275d7529f
Nov 29 23:05:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4d43b80-f79c-4631-bd95-f3c21a3226b3 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "254dca38-2e6d-4303-86af-369275d7529f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received event network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] Acquiring lock "254dca38-2e6d-4303-86af-369275d7529f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] Lock "254dca38-2e6d-4303-86af-369275d7529f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] No waiting events found dispatching network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:19 user nova-compute[75244]: WARNING nova.compute.manager [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: 254dca38-2e6d-4303-86af-369275d7529f] Received unexpected event network-vif-plugged-bcfc38e7-ba5b-4666-a8fd-1c032ea44bf7 for instance with vm_state deleted and task_state None.
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing instance network info cache due to event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updated VIF entry in instance network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1786c7f-0787-446c-b5d2-63d7f48150a7 req-48887b61-167f-46fc-9b8e-ac13b5157bb5 service nova] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing instance network info cache due to event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updated VIF entry in instance network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d0f71d02-701c-4149-891b-b475a615d6c2 req-5e30d005-6e08-4140-9f38-ddc1988a4087 service nova] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:25 user nova-compute[75244]: INFO nova.compute.manager [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Rebooting instance
Nov 29 23:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-3760ca74-e36e-4537-96d3-339a2789719e req-109dd275-281b-4729-9a1f-23c1134513a0 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-unplugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3760ca74-e36e-4537-96d3-339a2789719e req-109dd275-281b-4729-9a1f-23c1134513a0 service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3760ca74-e36e-4537-96d3-339a2789719e req-109dd275-281b-4729-9a1f-23c1134513a0 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3760ca74-e36e-4537-96d3-339a2789719e req-109dd275-281b-4729-9a1f-23c1134513a0 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-3760ca74-e36e-4537-96d3-339a2789719e req-109dd275-281b-4729-9a1f-23c1134513a0 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-unplugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:26 user nova-compute[75244]: WARNING nova.compute.manager [req-3760ca74-e36e-4537-96d3-339a2789719e req-109dd275-281b-4729-9a1f-23c1134513a0 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-unplugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 23:05:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance destroyed successfully.
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'resources' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-396357613',display_name='tempest-TestMinimumBasicScenario-server-396357613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-396357613',id=11,image_ref='8535e5de-ca54-45f0-8b70-966754936146',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLScX4pqdrRr1ln97nLX+ALZdsjG8lNthiDFSqMku/DFwNFXN8t5ry3Zzu087GXOadHq194avwX07szSnPVyAiIQ/72vKRThTMo1Hwn9OSVqr5I+IPcKXokLXWn8ra0klA==',key_name='tempest-TestMinimumBasicScenario-1615951852',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-br2k38jo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8535e5de-ca54-45f0-8b70-966754936146',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:05:26Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=f54c0598-0bc1-40c2-ae18-db0bc62f3039,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93559b4-ae, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3455fc0b-b4ea-4b23-ac46-1d7bb9a8cece) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:26 user nova-compute[75244]: INFO os_vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae')
Nov 29 23:05:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:26 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c9dba6-6460-444c-9d01-6e3f482f75e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:05:26 user nova-compute[75244]: No targets found.
Nov 29 23:05:26 user nova-compute[75244]: iSNS:
Nov 29 23:05:26 user nova-compute[75244]: No targets found.
Nov 29 23:05:26 user nova-compute[75244]: STATIC:
Nov 29 23:05:26 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:05:26 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:26 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:26 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03
Nov 29 23:05:26 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:26 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:26 user nova-compute[75244]: FIRMWARE:
Nov 29 23:05:26 user nova-compute[75244]: No targets found.
Nov 29 23:05:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:05:26 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:05:26 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc33ad-f566-473e-ada8-ebeb328a7cbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9026ff-a961-4999-8f51-7fde4167e164]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:26 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:26 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804461f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e9f864-9274-4e24-811d-324a0d7a17c6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[537308ed-030b-4deb-b5a3-a4d0b4f97d90]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9348eba4-6315-49e1-8094-d9764cfbbfe3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:05:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d07cd85-a44f-497d-a6d3-c7134758391a]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eb020c-432c-4aa1-8c7b-ff81a57aeaf6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[18725791-448a-47cd-ba99-c5ff785b55c0]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]
Nov 29 23:05:27 user nova-compute[75244]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a170e1-4f97-4b17-9998-e5343bbc38a3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== disconnect_volume: return (291ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Start _get_guest_xml network_info=[{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8535e5de-ca54-45f0-8b70-966754936146,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': '8535e5de-ca54-45f0-8b70-966754936146'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f54c0598-0bc1-40c2-ae18-db0bc62f3039', 'attached_at': '', 'detached_at': '', 'volume_id': '461de32b-485a-43f2-a2d3-75801f587a03', 'serial': '461de32b-485a-43f2-a2d3-75801f587a03'}, 'attachment_id': '11746f58-4495-4186-9e1b-daefc88fcb82', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:05:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8535e5de-ca54-45f0-8b70-966754936146,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'vcpu_model' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.objects.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Object Instance<f54c0598-0bc1-40c2-ae18-db0bc62f3039> lazy-loaded attributes: resources,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:27 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:27 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:27 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[52608ae4-1ac2-42fb-889d-a2d0c7c02904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:05:27 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[702274e6-f9e2-40ff-a888-2c5a7b26ab64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03] added
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c0f988-a73c-40b8-8f56-193a6268bada]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[187122d8-78d8-4fd7-a5b0-7c2c1028328c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyebdYQD {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyebdYQD" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23729e34-88a1-48a9-b9e8-c0cf57ad28fd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IyebdYQD'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[396e7c18-4e2e-4e99-83a1-5cfa2bd6ec9f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fa329e-d67a-43e0-8966-2ea0cf5b654c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[17871119-6f58-46bf-9b3c-5ed5c9b186f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]
Nov 29 23:05:27 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cb1b7c-ee7d-4408-905a-72f9359baa47]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[00835eff-9252-4ea0-a18d-d28591df254e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:27 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:27 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[380905fd-8d9c-4c75-9023-2df0cd5a2783]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:05:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-9aaae062-1084-437f-900a-753ee5bc6c14 req-c3a2ce82-a92c-46b5-acb6-116a77a5573a service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9aaae062-1084-437f-900a-753ee5bc6c14 req-c3a2ce82-a92c-46b5-acb6-116a77a5573a service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9aaae062-1084-437f-900a-753ee5bc6c14 req-c3a2ce82-a92c-46b5-acb6-116a77a5573a service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9aaae062-1084-437f-900a-753ee5bc6c14 req-c3a2ce82-a92c-46b5-acb6-116a77a5573a service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-9aaae062-1084-437f-900a-753ee5bc6c14 req-c3a2ce82-a92c-46b5-acb6-116a77a5573a service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:28 user nova-compute[75244]: WARNING nova.compute.manager [req-9aaae062-1084-437f-900a-753ee5bc6c14 req-c3a2ce82-a92c-46b5-acb6-116a77a5573a service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 23:05:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26663336333313266', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663336333313266', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-396357613',display_name='tempest-TestMinimumBasicScenario-server-396357613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-396357613',id=11,image_ref='8535e5de-ca54-45f0-8b70-966754936146',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLScX4pqdrRr1ln97nLX+ALZdsjG8lNthiDFSqMku/DFwNFXN8t5ry3Zzu087GXOadHq194avwX07szSnPVyAiIQ/72vKRThTMo1Hwn9OSVqr5I+IPcKXokLXWn8ra0klA==',key_name='tempest-TestMinimumBasicScenario-1615951852',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-br2k38jo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8535e5de-ca54-45f0-8b70-966754936146',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:05:26Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=f54c0598-0bc1-40c2-ae18-db0bc62f3039,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'pci_devices' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.objects.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Object Instance<f54c0598-0bc1-40c2-ae18-db0bc62f3039> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:05:28 user nova-compute[75244]:   <uuid>f54c0598-0bc1-40c2-ae18-db0bc62f3039</uuid>
Nov 29 23:05:28 user nova-compute[75244]:   <name>instance-0000000b</name>
Nov 29 23:05:28 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:05:28 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:05:28 user nova-compute[75244]:   <metadata>
Nov 29 23:05:28 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:28 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:05:28 user nova-compute[75244]:       <nova:name>tempest-TestMinimumBasicScenario-server-396357613</nova:name>
Nov 29 23:05:28 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:05:27</nova:creationTime>
Nov 29 23:05:28 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:05:28 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:28 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:05:28 user nova-compute[75244]:       <nova:owner>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:user uuid="34cc981cad504120ac7e4507e9c08fcd">tempest-TestMinimumBasicScenario-1628079571-project-member</nova:user>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:project uuid="555c96d9ec5c48fe814663a5cdd84ffa">tempest-TestMinimumBasicScenario-1628079571</nova:project>
Nov 29 23:05:28 user nova-compute[75244]:       </nova:owner>
Nov 29 23:05:28 user nova-compute[75244]:       <nova:root type="image" uuid="8535e5de-ca54-45f0-8b70-966754936146"/>
Nov 29 23:05:28 user nova-compute[75244]:       <nova:ports>
Nov 29 23:05:28 user nova-compute[75244]:         <nova:port uuid="c93559b4-ae7f-48b3-8bb4-a3cead7495f7">
Nov 29 23:05:28 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 23:05:28 user nova-compute[75244]:         </nova:port>
Nov 29 23:05:28 user nova-compute[75244]:       </nova:ports>
Nov 29 23:05:28 user nova-compute[75244]:     </nova:instance>
Nov 29 23:05:28 user nova-compute[75244]:   </metadata>
Nov 29 23:05:28 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:05:28 user nova-compute[75244]:     <system>
Nov 29 23:05:28 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:05:28 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:05:28 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:05:28 user nova-compute[75244]:       <entry name="serial">f54c0598-0bc1-40c2-ae18-db0bc62f3039</entry>
Nov 29 23:05:28 user nova-compute[75244]:       <entry name="uuid">f54c0598-0bc1-40c2-ae18-db0bc62f3039</entry>
Nov 29 23:05:28 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:05:28 user nova-compute[75244]:     </system>
Nov 29 23:05:28 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:28 user nova-compute[75244]:   <os>
Nov 29 23:05:28 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:05:28 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:05:28 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:05:28 user nova-compute[75244]:   </os>
Nov 29 23:05:28 user nova-compute[75244]:   <features>
Nov 29 23:05:28 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:28 user nova-compute[75244]:     <apic/>
Nov 29 23:05:28 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:05:28 user nova-compute[75244]:   </features>
Nov 29 23:05:28 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:05:28 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:05:28 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:05:28 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:05:28 user nova-compute[75244]:   </clock>
Nov 29 23:05:28 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:05:28 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:05:28 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:05:28 user nova-compute[75244]:   </cpu>
Nov 29 23:05:28 user nova-compute[75244]:   <devices>
Nov 29 23:05:28 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:05:28 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:05:28 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk"/>
Nov 29 23:05:28 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:05:28 user nova-compute[75244]:     </disk>
Nov 29 23:05:28 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:05:28 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:05:28 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:05:28 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:05:28 user nova-compute[75244]:       <serial>461de32b-485a-43f2-a2d3-75801f587a03</serial>
Nov 29 23:05:28 user nova-compute[75244]:     </disk>
Nov 29 23:05:28 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:05:28 user nova-compute[75244]:       <mac address="fa:16:3e:ff:ff:ed"/>
Nov 29 23:05:28 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:28 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:05:28 user nova-compute[75244]:       <target dev="tapc93559b4-ae"/>
Nov 29 23:05:28 user nova-compute[75244]:     </interface>
Nov 29 23:05:28 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:05:28 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/console.log" append="off"/>
Nov 29 23:05:28 user nova-compute[75244]:     </serial>
Nov 29 23:05:28 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:05:28 user nova-compute[75244]:     <video>
Nov 29 23:05:28 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:28 user nova-compute[75244]:     </video>
Nov 29 23:05:28 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:05:28 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:05:28 user nova-compute[75244]:     </rng>
Nov 29 23:05:28 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:05:28 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:05:28 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:05:28 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:28 user nova-compute[75244]:   </devices>
Nov 29 23:05:28 user nova-compute[75244]: </domain>
Nov 29 23:05:28 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'trusted_certs' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG nova.objects.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Object Instance<f54c0598-0bc1-40c2-ae18-db0bc62f3039> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Cannot resize image /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'migration_context' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.objects.base [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Object Instance<f54c0598-0bc1-40c2-ae18-db0bc62f3039> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-396357613',display_name='tempest-TestMinimumBasicScenario-server-396357613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-396357613',id=11,image_ref='8535e5de-ca54-45f0-8b70-966754936146',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLScX4pqdrRr1ln97nLX+ALZdsjG8lNthiDFSqMku/DFwNFXN8t5ry3Zzu087GXOadHq194avwX07szSnPVyAiIQ/72vKRThTMo1Hwn9OSVqr5I+IPcKXokLXWn8ra0klA==',key_name='tempest-TestMinimumBasicScenario-1615951852',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-br2k38jo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8535e5de-ca54-45f0-8b70-966754936146',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:05:26Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=f54c0598-0bc1-40c2-ae18-db0bc62f3039,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG os_vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f71a39f-6f68-5277-b7cb-a1f1f91c872b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93559b4-ae, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc93559b4-ae, col_values=(('qos', UUID('7bf3f536-8cfc-492c-b31c-8a0ba7a422f7')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc93559b4-ae, col_values=(('external_ids', {'iface-id': 'c93559b4-ae7f-48b3-8bb4-a3cead7495f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:ff:ed', 'vm-uuid': 'f54c0598-0bc1-40c2-ae18-db0bc62f3039'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:29 user nova-compute[75244]: INFO os_vif [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae')
Nov 29 23:05:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-ba6d4d01-fdd3-4d6e-a417-191db34426c6 req-e8d14c1a-4eab-491d-a40b-03903da69db3 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba6d4d01-fdd3-4d6e-a417-191db34426c6 req-e8d14c1a-4eab-491d-a40b-03903da69db3 service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba6d4d01-fdd3-4d6e-a417-191db34426c6 req-e8d14c1a-4eab-491d-a40b-03903da69db3 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ba6d4d01-fdd3-4d6e-a417-191db34426c6 req-e8d14c1a-4eab-491d-a40b-03903da69db3 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-ba6d4d01-fdd3-4d6e-a417-191db34426c6 req-e8d14c1a-4eab-491d-a40b-03903da69db3 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:30 user nova-compute[75244]: WARNING nova.compute.manager [req-ba6d4d01-fdd3-4d6e-a417-191db34426c6 req-e8d14c1a-4eab-491d-a40b-03903da69db3 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 23:05:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:31 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updating instance_info_cache with network_info: [{"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-f2b866e9-d721-494e-b4ce-9605047d87de" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:05:32 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance rebooted successfully.
Nov 29 23:05:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-3f895681-8fd4-457a-908b-171384d5089a req-e438f072-0a44-42f1-825b-66202f7f4f90 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3f895681-8fd4-457a-908b-171384d5089a req-e438f072-0a44-42f1-825b-66202f7f4f90 service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3f895681-8fd4-457a-908b-171384d5089a req-e438f072-0a44-42f1-825b-66202f7f4f90 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3f895681-8fd4-457a-908b-171384d5089a req-e438f072-0a44-42f1-825b-66202f7f4f90 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-3f895681-8fd4-457a-908b-171384d5089a req-e438f072-0a44-42f1-825b-66202f7f4f90 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:33 user nova-compute[75244]: WARNING nova.compute.manager [req-3f895681-8fd4-457a-908b-171384d5089a req-e438f072-0a44-42f1-825b-66202f7f4f90 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7eb902e-83d4-47bc-923b-171eca6474ab tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.737s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:05:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=25.339462280273438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:05:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f2b866e9-d721-494e-b4ce-9605047d87de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance d659418e-64fb-4c3e-9569-7011295c252b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b8ceea92-f765-46a7-8851-3bdacb386732 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:37 user nova-compute[75244]: INFO nova.compute.manager [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Terminating instance
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-3ecbc6d9-e92e-49ad-a4bd-15c301ee9283 req-17f42249-f9a8-4a9a-9566-06ac187d06d4 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-unplugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3ecbc6d9-e92e-49ad-a4bd-15c301ee9283 req-17f42249-f9a8-4a9a-9566-06ac187d06d4 service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3ecbc6d9-e92e-49ad-a4bd-15c301ee9283 req-17f42249-f9a8-4a9a-9566-06ac187d06d4 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3ecbc6d9-e92e-49ad-a4bd-15c301ee9283 req-17f42249-f9a8-4a9a-9566-06ac187d06d4 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-3ecbc6d9-e92e-49ad-a4bd-15c301ee9283 req-17f42249-f9a8-4a9a-9566-06ac187d06d4 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-unplugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-3ecbc6d9-e92e-49ad-a4bd-15c301ee9283 req-17f42249-f9a8-4a9a-9566-06ac187d06d4 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-unplugged-df674a1e-ea01-45a5-8867-f3ce46592f03 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Instance destroyed successfully.
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.objects.instance [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lazy-loading 'resources' on Instance uuid c81a4813-3b3c-4bf1-a3fe-d623aab59a1c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-262656022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-262656022',id=6,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKtvZGQDmrDcDa9UA7cPXc9hP/kSs7qhGgVgHTZYoEMiaMJCDJfR5C1NlQtCGWCZLJIPfqjyoQo2tHsjpo0yTdMRZX9NWcuQcHr2ftztZ9yp54NR+m4dkBAvSe3/gWNg==',key_name='tempest-keypair-1279162367',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2123fd8af384a46bd4d6baee7f1583d',ramdisk_id='',reservation_id='r-8e8x2mw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1155771791',owner_user_name='tempest-TaggedAttachmentsTest-1155771791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bfa897438554825be52e4c5c45ea3c0',uuid=c81a4813-3b3c-4bf1-a3fe-d623aab59a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converting VIF {"id": "df674a1e-ea01-45a5-8867-f3ce46592f03", "address": "fa:16:3e:37:d9:57", "network": {"id": "8b867f68-a892-4a3b-8cef-84091331a675", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2129519243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2123fd8af384a46bd4d6baee7f1583d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf674a1e-ea", "ovs_interfaceid": "df674a1e-ea01-45a5-8867-f3ce46592f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG os_vif [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf674a1e-ea, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d858af7f-a08c-4f94-9a72-dcb52c7967db) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:38 user nova-compute[75244]: INFO os_vif [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:d9:57,bridge_name='br-int',has_traffic_filtering=True,id=df674a1e-ea01-45a5-8867-f3ce46592f03,network=Network(8b867f68-a892-4a3b-8cef-84091331a675),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf674a1e-ea')
Nov 29 23:05:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Deleting instance files /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c_del
Nov 29 23:05:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Deletion of /opt/stack/data/nova/instances/c81a4813-3b3c-4bf1-a3fe-d623aab59a1c_del complete
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:05:38 user nova-compute[75244]: INFO nova.compute.manager [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 23:05:38 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:05:38 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:39 user nova-compute[75244]: INFO nova.compute.manager [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Unshelving
Nov 29 23:05:39 user nova-compute[75244]: INFO nova.virt.block_device [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Booting with volume 57d70862-7a8b-47b5-8aaf-9af1df5a579e at /dev/vdc
Nov 29 23:05:39 user nova-compute[75244]: DEBUG os_brick.utils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fb8c2-2967-4e09-ad20-0e774669df27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddafc96-520e-4631-a33c-3d82a951308e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f98c15-3f42-4840-893d-dc19d74b9512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ae4496-4748-43d1-a504-34664a1b3a1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:05:39 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:05:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63c9efa-04fc-40e2-bf95-786864032e4b]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG os_brick.utils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating existing volume attachment record: c38fba1d-aa38-475f-a027-45144853df0f {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:05:39 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:39 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Took 1.21 seconds to deallocate network for instance.
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] Acquiring lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] No waiting events found dispatching network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:40 user nova-compute[75244]: WARNING nova.compute.manager [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received unexpected event network-vif-plugged-df674a1e-ea01-45a5-8867-f3ce46592f03 for instance with vm_state deleted and task_state None.
Nov 29 23:05:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce60fc14-7703-486c-b29e-ac0c8bf16be3 req-cde93423-a6b0-42dd-91ff-f4996986a718 service nova] [instance: c81a4813-3b3c-4bf1-a3fe-d623aab59a1c] Received event network-vif-deleted-df674a1e-ea01-45a5-8867-f3ce46592f03 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:40 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Deleted allocations for instance c81a4813-3b3c-4bf1-a3fe-d623aab59a1c
Nov 29 23:05:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-19f820e4-81cc-4177-85a3-6c280ab675e3 tempest-TaggedAttachmentsTest-1155771791 tempest-TaggedAttachmentsTest-1155771791-project-member] Lock "c81a4813-3b3c-4bf1-a3fe-d623aab59a1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.105s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:43 user nova-compute[75244]: INFO nova.compute.manager [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Terminating instance
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb171ea7-35b7-42a2-910b-61449eb0d6be req-9d3de17a-ec05-412b-9952-0b11ccde2f48 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-vif-unplugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb171ea7-35b7-42a2-910b-61449eb0d6be req-9d3de17a-ec05-412b-9952-0b11ccde2f48 service nova] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb171ea7-35b7-42a2-910b-61449eb0d6be req-9d3de17a-ec05-412b-9952-0b11ccde2f48 service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb171ea7-35b7-42a2-910b-61449eb0d6be req-9d3de17a-ec05-412b-9952-0b11ccde2f48 service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb171ea7-35b7-42a2-910b-61449eb0d6be req-9d3de17a-ec05-412b-9952-0b11ccde2f48 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] No waiting events found dispatching network-vif-unplugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb171ea7-35b7-42a2-910b-61449eb0d6be req-9d3de17a-ec05-412b-9952-0b11ccde2f48 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-vif-unplugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:05:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Instance destroyed successfully.
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lazy-loading 'resources' on Instance uuid f0ba7f3a-d135-415c-a9dd-38c568e26e15 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2046836676',display_name='tempest-TestVolumeSwap-server-2046836676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2046836676',id=8,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzXotpmqZakhy67laNJ0F1VKq4x1KYZte1IwmhKNBgWPyJV9sojFCmFVUOK8MGqkhQl1QKc0KVfqd//YW9LbmqLRwCgBnGDkxwsMzfi+VlK4+1rS5/okJvA7kDJxPvPAA==',key_name='tempest-keypair-1093743525',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4c83d749e4d5c891170e8c04ea612',ramdisk_id='',reservation_id='r-008edy24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1495091483',owner_user_name='tempest-TestVolumeSwap-1495091483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db43bd663d442daa8df5180c33e952c',uuid=f0ba7f3a-d135-415c-a9dd-38c568e26e15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Converting VIF {"id": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "address": "fa:16:3e:36:c5:36", "network": {"id": "1faba386-7242-4d28-be85-ee5f51705f8c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1677803871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4c83d749e4d5c891170e8c04ea612", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff31a3d0-b8", "ovs_interfaceid": "ff31a3d0-b874-45be-b780-cfa11a7053d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG os_vif [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff31a3d0-b8, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a4fa454-0d55-4d34-a4e6-6c0baff7cba1) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:43 user nova-compute[75244]: INFO os_vif [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=ff31a3d0-b874-45be-b780-cfa11a7053d0,network=Network(1faba386-7242-4d28-be85-ee5f51705f8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff31a3d0-b8')
Nov 29 23:05:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Deleting instance files /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15_del
Nov 29 23:05:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Deletion of /opt/stack/data/nova/instances/f0ba7f3a-d135-415c-a9dd-38c568e26e15_del complete
Nov 29 23:05:43 user nova-compute[75244]: INFO nova.compute.manager [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 23:05:43 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:05:43 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:05:44 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:44 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Took 0.81 seconds to deallocate network for instance.
Nov 29 23:05:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-c7221d38-7608-4ec3-abcd-a6ca61f1015e req-37ae54d7-08f1-4262-afa9-0cdb50e0661f service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-vif-deleted-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:44 user nova-compute[75244]: INFO nova.compute.manager [req-c7221d38-7608-4ec3-abcd-a6ca61f1015e req-37ae54d7-08f1-4262-afa9-0cdb50e0661f service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Neutron deleted interface ff31a3d0-b874-45be-b780-cfa11a7053d0; detaching it from the instance and deleting it from the info cache
Nov 29 23:05:44 user nova-compute[75244]: DEBUG nova.network.neutron [req-c7221d38-7608-4ec3-abcd-a6ca61f1015e req-37ae54d7-08f1-4262-afa9-0cdb50e0661f service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-c7221d38-7608-4ec3-abcd-a6ca61f1015e req-37ae54d7-08f1-4262-afa9-0cdb50e0661f service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Detach interface failed, port_id=ff31a3d0-b874-45be-b780-cfa11a7053d0, reason: Instance f0ba7f3a-d135-415c-a9dd-38c568e26e15 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:05:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:45 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Deleted allocations for instance f0ba7f3a-d135-415c-a9dd-38c568e26e15
Nov 29 23:05:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4c3e027d-56e2-4ddb-bf85-3c93c992f124 tempest-TestVolumeSwap-1495091483 tempest-TestVolumeSwap-1495091483-project-member] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-dae9ea68-5ac6-4c6e-8bc7-bc5717e366fa req-55bddd28-55d9-4a99-8a91-c2e28ea84596 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received event network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dae9ea68-5ac6-4c6e-8bc7-bc5717e366fa req-55bddd28-55d9-4a99-8a91-c2e28ea84596 service nova] Acquiring lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dae9ea68-5ac6-4c6e-8bc7-bc5717e366fa req-55bddd28-55d9-4a99-8a91-c2e28ea84596 service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dae9ea68-5ac6-4c6e-8bc7-bc5717e366fa req-55bddd28-55d9-4a99-8a91-c2e28ea84596 service nova] Lock "f0ba7f3a-d135-415c-a9dd-38c568e26e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-dae9ea68-5ac6-4c6e-8bc7-bc5717e366fa req-55bddd28-55d9-4a99-8a91-c2e28ea84596 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] No waiting events found dispatching network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:45 user nova-compute[75244]: WARNING nova.compute.manager [req-dae9ea68-5ac6-4c6e-8bc7-bc5717e366fa req-55bddd28-55d9-4a99-8a91-c2e28ea84596 service nova] [instance: f0ba7f3a-d135-415c-a9dd-38c568e26e15] Received unexpected event network-vif-plugged-ff31a3d0-b874-45be-b780-cfa11a7053d0 for instance with vm_state deleted and task_state None.
Nov 29 23:05:47 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:47 user nova-compute[75244]: DEBUG nova.network.neutron [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:05:47 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'info_cache' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:47 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:48 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance destroyed successfully.
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'resources' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69add1a4-a1, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22dc88be-d1f7-4c26-bd03-73bd114778da) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:48 user nova-compute[75244]: INFO os_vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1')
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:48 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e211dc4b-bc1d-47bb-a01e-3ac55b710c5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:05:48 user nova-compute[75244]: No targets found.
Nov 29 23:05:48 user nova-compute[75244]: iSNS:
Nov 29 23:05:48 user nova-compute[75244]: No targets found.
Nov 29 23:05:48 user nova-compute[75244]: STATIC:
Nov 29 23:05:48 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:05:48 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:48 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:48 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03
Nov 29 23:05:48 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:05:48 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:05:48 user nova-compute[75244]: FIRMWARE:
Nov 29 23:05:48 user nova-compute[75244]: No targets found.
Nov 29 23:05:48 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:05:48 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:05:48 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487dd5f-739c-43cd-9a90-5ee3e13da103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91fb2e-62ad-4cba-83d3-f1309a8de0c7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:48 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:48 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:48 user nova-compute[75244]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:48 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c40ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb52122-4563-49cf-8a56-da559b6e130d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d9c5df-54a0-4f80-9a80-92c6f1ca92b9]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[230d0628-9e93-49e7-abf7-085a9b880f3d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.071s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb50ba71-770c-4081-b0de-2b1616157319]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2448469-d72f-47d8-8fd9-0a896264d2b7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7983a8-76c8-45ee-8124-7b78af8dc890]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]
Nov 29 23:05:48 user nova-compute[75244]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:48 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9288e3-3663-4887-929e-a389928cc78c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== disconnect_volume: return (352ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start _get_guest_xml network_info=[{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '019c268b-dc0f-4e68-95e2-f26f5c24463b', 'attached_at': '', 'detached_at': '', 'volume_id': '5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'serial': '5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d'}, 'attachment_id': '9fec876c-a304-4c2f-a553-a2e25c7f2180', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'numa_topology' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'pci_requests' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'numa_topology' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:48 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:48 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:05:48 user nova-compute[75244]: INFO nova.compute.claims [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Claim successful on node user
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'vcpu_model' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:48 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:48 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:48 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aeb756-832c-4ef1-88ed-78d157f7ab76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:05:48 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03d05dd-d11d-4af1-929e-a6fca34f8138]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d] added
Nov 29 23:05:48 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262cf4a-af3d-4fa4-a32b-a12b80aa7979]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd510c-7667-48e8-9fcd-2869f074409a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmGolsAe {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmGolsAe" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8cd11a-0dbf-4bf8-8caa-fd003db2f499]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KmGolsAe'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eafc33-0736-4af9-854b-eb155ee60c92]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b987017-1143-48e8-860f-4da3cd8564d7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc11303-b888-48aa-a807-d80a0eceeb97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]
Nov 29 23:05:49 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3aa4ef-221b-47d1-82b3-28aa2d5dad76]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7235d1e-45f2-47d7-86f2-be6c694a3c5a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:49 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:49 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4627e-98fd-4e0d-9c02-a223efd98e1b]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:05:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:49 user nova-compute[75244]: INFO nova.network.neutron [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating port 8309daad-6231-443d-9aa1-9b46adbc6fea with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23532376331363231', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532376331363231', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'pci_devices' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:05:50 user nova-compute[75244]:   <uuid>019c268b-dc0f-4e68-95e2-f26f5c24463b</uuid>
Nov 29 23:05:50 user nova-compute[75244]:   <name>instance-00000003</name>
Nov 29 23:05:50 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:05:50 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:05:50 user nova-compute[75244]:   <metadata>
Nov 29 23:05:50 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:50 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:05:50 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeTestJSON-server-2138708551</nova:name>
Nov 29 23:05:50 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:05:48</nova:creationTime>
Nov 29 23:05:50 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:05:50 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:50 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:05:50 user nova-compute[75244]:       <nova:owner>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:user uuid="aab2f432fdbf48d3bc546158221a1448">tempest-AttachVolumeTestJSON-2123642001-project-member</nova:user>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:project uuid="8b3fc795bdd143a9bbb8b3d5a040e92f">tempest-AttachVolumeTestJSON-2123642001</nova:project>
Nov 29 23:05:50 user nova-compute[75244]:       </nova:owner>
Nov 29 23:05:50 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:05:50 user nova-compute[75244]:       <nova:ports>
Nov 29 23:05:50 user nova-compute[75244]:         <nova:port uuid="69add1a4-a188-4454-9331-c39bffcd8b49">
Nov 29 23:05:50 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:05:50 user nova-compute[75244]:         </nova:port>
Nov 29 23:05:50 user nova-compute[75244]:       </nova:ports>
Nov 29 23:05:50 user nova-compute[75244]:     </nova:instance>
Nov 29 23:05:50 user nova-compute[75244]:   </metadata>
Nov 29 23:05:50 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:05:50 user nova-compute[75244]:     <system>
Nov 29 23:05:50 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:05:50 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:05:50 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:05:50 user nova-compute[75244]:       <entry name="serial">019c268b-dc0f-4e68-95e2-f26f5c24463b</entry>
Nov 29 23:05:50 user nova-compute[75244]:       <entry name="uuid">019c268b-dc0f-4e68-95e2-f26f5c24463b</entry>
Nov 29 23:05:50 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:05:50 user nova-compute[75244]:     </system>
Nov 29 23:05:50 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:50 user nova-compute[75244]:   <os>
Nov 29 23:05:50 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:05:50 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:05:50 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:05:50 user nova-compute[75244]:   </os>
Nov 29 23:05:50 user nova-compute[75244]:   <features>
Nov 29 23:05:50 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:50 user nova-compute[75244]:     <apic/>
Nov 29 23:05:50 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:05:50 user nova-compute[75244]:   </features>
Nov 29 23:05:50 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:05:50 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:05:50 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:05:50 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:05:50 user nova-compute[75244]:   </clock>
Nov 29 23:05:50 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:05:50 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:05:50 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:05:50 user nova-compute[75244]:   </cpu>
Nov 29 23:05:50 user nova-compute[75244]:   <devices>
Nov 29 23:05:50 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:05:50 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:05:50 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk"/>
Nov 29 23:05:50 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:05:50 user nova-compute[75244]:     </disk>
Nov 29 23:05:50 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:05:50 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:05:50 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:05:50 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:05:50 user nova-compute[75244]:       <serial>5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d</serial>
Nov 29 23:05:50 user nova-compute[75244]:     </disk>
Nov 29 23:05:50 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:05:50 user nova-compute[75244]:       <mac address="fa:16:3e:96:27:05"/>
Nov 29 23:05:50 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:50 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:05:50 user nova-compute[75244]:       <target dev="tap69add1a4-a1"/>
Nov 29 23:05:50 user nova-compute[75244]:     </interface>
Nov 29 23:05:50 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:05:50 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/console.log" append="off"/>
Nov 29 23:05:50 user nova-compute[75244]:     </serial>
Nov 29 23:05:50 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:05:50 user nova-compute[75244]:     <video>
Nov 29 23:05:50 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:50 user nova-compute[75244]:     </video>
Nov 29 23:05:50 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:05:50 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:05:50 user nova-compute[75244]:     </rng>
Nov 29 23:05:50 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:05:50 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:05:50 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:05:50 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:50 user nova-compute[75244]:   </devices>
Nov 29 23:05:50 user nova-compute[75244]: </domain>
Nov 29 23:05:50 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing instance network info cache due to event network-changed-8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] Acquiring lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'trusted_certs' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:05:50 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Creating image(s)
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'trusted_certs' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] Acquired lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.network.neutron [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Refreshing network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.objects.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<98d0cfec-ab5d-49a0-a467-f90989f51aa0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "d319d3c308dc9a89279c5d7963913e3b9b52d3f2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "d319d3c308dc9a89279c5d7963913e3b9b52d3f2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:05:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 1.150s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Cannot resize image /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'migration_context' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.objects.base [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG os_vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a264fd11-71ca-5439-a669-6157452ef944', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69add1a4-a1, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69add1a4-a1, col_values=(('qos', UUID('403352b5-68cc-474a-8edd-9c1b26c16ebd')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69add1a4-a1, col_values=(('external_ids', {'iface-id': '69add1a4-a188-4454-9331-c39bffcd8b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:27:05', 'vm-uuid': '019c268b-dc0f-4e68-95e2-f26f5c24463b'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:52 user nova-compute[75244]: INFO os_vif [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1')
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.part --force-share --output=json" returned: 0 in 0.219s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.virt.images [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] 46cd4d46-cfb9-4216-b016-2a6230a5b2e5 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.part /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-changed-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Refreshing instance network info cache due to event network-changed-2721fa9f-cbf6-4e2b-979a-e045ae5547fb. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] Acquiring lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] Acquired lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Refreshing network info cache for port 2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.part /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.converted" returned: 0 in 0.353s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updated VIF entry in instance network info cache for port 8309daad-6231-443d-9aa1-9b46adbc6fea. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9753c8ac-489d-48c3-810a-4881ab6bc70f req-6602d9c9-e0b0-42b6-929e-ea892cd32f0a service nova] Releasing lock "refresh_cache-98d0cfec-ab5d-49a0-a467-f90989f51aa0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "d319d3c308dc9a89279c5d7963913e3b9b52d3f2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.893s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "d319d3c308dc9a89279c5d7963913e3b9b52d3f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "d319d3c308dc9a89279c5d7963913e3b9b52d3f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2,backing_fmt=raw /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updated VIF entry in instance network info cache for port 2721fa9f-cbf6-4e2b-979a-e045ae5547fb. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updating instance_info_cache with network_info: [{"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2,backing_fmt=raw /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk 1073741824" returned: 0 in 0.066s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "d319d3c308dc9a89279c5d7963913e3b9b52d3f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb5faae0-79f2-492c-8461-a7e38f4ef91e req-76ee4e13-8223-416e-b297-1305043ec6b7 service nova] Releasing lock "refresh_cache-d659418e-64fb-4c3e-9569-7011295c252b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 --force-share --output=json" returned: 0 in 0.233s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'migration_context' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG nova.objects.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<98d0cfec-ab5d-49a0-a467-f90989f51aa0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Rebasing disk image.
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.245s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 -F raw /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.016s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.objects.instance [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lazy-loading 'flavor' on Instance uuid d659418e-64fb-4c3e-9569-7011295c252b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:56 user nova-compute[75244]: INFO nova.compute.manager [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Attaching volume 4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 to /dev/vdb
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 -F raw /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk" returned: 0 in 2.885s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Ensure instance console log exists: /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Start _get_guest_xml network_info=[{"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='faf247b42660aec4435d020723e7e4c8',container_format='bare',created_at=2023-11-29T23:03:46Z,direct_url=<?>,disk_format='qcow2',id=46cd4d46-cfb9-4216-b016-2a6230a5b2e5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1788131671-shelved',owner='b273a67b0a2f462aa1092779f31fdc8a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T23:03:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PODwyecQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '98d0cfec-ab5d-49a0-a467-f90989f51aa0', 'attached_at': '', 'detached_at': '', 'volume_id': '57d70862-7a8b-47b5-8aaf-9af1df5a579e', 'serial': '57d70862-7a8b-47b5-8aaf-9af1df5a579e'}, 'attachment_id': 'c38fba1d-aa38-475f-a027-45144853df0f', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.utils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='faf247b42660aec4435d020723e7e4c8',container_format='bare',created_at=2023-11-29T23:03:46Z,direct_url=<?>,disk_format='qcow2',id=46cd4d46-cfb9-4216-b016-2a6230a5b2e5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1788131671-shelved',owner='b273a67b0a2f462aa1092779f31fdc8a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T23:03:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf7f2f-4e16-4086-aa2c-1ea2ee748410]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f97873b-0c9e-403f-8d99-3400c7c88bd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.objects.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<98d0cfec-ab5d-49a0-a467-f90989f51aa0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PODwyecQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:05:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:05:56 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e5d63-8dca-40bf-ad7c-93d1b395a4ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[544d1371-0008-4388-925c-042c2ccb0ddc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0e1a14-6d0e-4d60-82f6-8d51eccfb657]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:05:56 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance rebooted successfully.
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-4b59927e-6450-4b5a-b055-3a1ceb217da2 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:05:56 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[04440e08-48ae-471b-bc81-8cdcc106f321]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed7ab0-8299-4f7f-b2f4-68a8f86be9a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.utils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updating existing volume attachment record: c1d787de-72e8-4b8c-bbf1-e38d8776e359 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e] added
Nov 29 23:05:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[798f5b28-d54a-4205-8243-ffaf12428c48]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d0c798-1ac0-4f84-a8a5-7b0820f952a2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PODwyecQ {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PODwyecQ" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb2127-75fc-4f9a-87ab-4f4c8f64a706]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PODwyecQ'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e7ea89-11aa-431a-9013-565b07b124fe]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[12691758-bbaa-4605-b258-1b72c6fee935]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:56 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:56 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae35d26-2b84-4edd-9883-64e1e7736c9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260]
Nov 29 23:05:57 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260] successful.
Nov 29 23:05:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d8217-af30-465e-9136-657a5de26ec1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[06925fe7-6f23-4388-8c26-bb62a73d6986]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:57 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:57 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:05:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:05:57 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:05:57 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:05:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bcbe69-0250-4a95-a51b-3b6a7f758d61]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PODwyecQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-9daae650-b4ca-41e3-844d-aec55b188c2e req-ee391ed8-4bb8-468a-874a-a1bbbe8eaa70 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9daae650-b4ca-41e3-844d-aec55b188c2e req-ee391ed8-4bb8-468a-874a-a1bbbe8eaa70 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9daae650-b4ca-41e3-844d-aec55b188c2e req-ee391ed8-4bb8-468a-874a-a1bbbe8eaa70 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9daae650-b4ca-41e3-844d-aec55b188c2e req-ee391ed8-4bb8-468a-874a-a1bbbe8eaa70 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-9daae650-b4ca-41e3-844d-aec55b188c2e req-ee391ed8-4bb8-468a-874a-a1bbbe8eaa70 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:57 user nova-compute[75244]: WARNING nova.compute.manager [req-9daae650-b4ca-41e3-844d-aec55b188c2e req-ee391ed8-4bb8-468a-874a-a1bbbe8eaa70 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state active and task_state None.
Nov 29 23:05:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26532663433336437', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532663433336437', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1788131671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1788131671',id=4,image_ref='46cd4d46-cfb9-4216-b016-2a6230a5b2e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1743157863',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-oyfa3jdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member',shelved_at='2023-11-29T23:03:51.286571',shelved_host='user',shelved_image_id='46cd4d46-cfb9-4216-b016-2a6230a5b2e5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=98d0cfec-ab5d-49a0-a467-f90989f51aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'pci_devices' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.objects.base [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<98d0cfec-ab5d-49a0-a467-f90989f51aa0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:05:58 user nova-compute[75244]:   <uuid>98d0cfec-ab5d-49a0-a467-f90989f51aa0</uuid>
Nov 29 23:05:58 user nova-compute[75244]:   <name>instance-00000004</name>
Nov 29 23:05:58 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:05:58 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:05:58 user nova-compute[75244]:   <metadata>
Nov 29 23:05:58 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:05:58 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:05:58 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1788131671</nova:name>
Nov 29 23:05:58 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:05:56</nova:creationTime>
Nov 29 23:05:58 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:05:58 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:05:58 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:05:58 user nova-compute[75244]:       <nova:owner>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:user uuid="fe39bc0caf6f49368d0d0cb0789a1d3c">tempest-AttachVolumeShelveTestJSON-576906296-project-member</nova:user>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:project uuid="b273a67b0a2f462aa1092779f31fdc8a">tempest-AttachVolumeShelveTestJSON-576906296</nova:project>
Nov 29 23:05:58 user nova-compute[75244]:       </nova:owner>
Nov 29 23:05:58 user nova-compute[75244]:       <nova:root type="image" uuid="46cd4d46-cfb9-4216-b016-2a6230a5b2e5"/>
Nov 29 23:05:58 user nova-compute[75244]:       <nova:ports>
Nov 29 23:05:58 user nova-compute[75244]:         <nova:port uuid="8309daad-6231-443d-9aa1-9b46adbc6fea">
Nov 29 23:05:58 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 23:05:58 user nova-compute[75244]:         </nova:port>
Nov 29 23:05:58 user nova-compute[75244]:       </nova:ports>
Nov 29 23:05:58 user nova-compute[75244]:     </nova:instance>
Nov 29 23:05:58 user nova-compute[75244]:   </metadata>
Nov 29 23:05:58 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:05:58 user nova-compute[75244]:     <system>
Nov 29 23:05:58 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:05:58 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:05:58 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:05:58 user nova-compute[75244]:       <entry name="serial">98d0cfec-ab5d-49a0-a467-f90989f51aa0</entry>
Nov 29 23:05:58 user nova-compute[75244]:       <entry name="uuid">98d0cfec-ab5d-49a0-a467-f90989f51aa0</entry>
Nov 29 23:05:58 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:05:58 user nova-compute[75244]:     </system>
Nov 29 23:05:58 user nova-compute[75244]:   </sysinfo>
Nov 29 23:05:58 user nova-compute[75244]:   <os>
Nov 29 23:05:58 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:05:58 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:05:58 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:05:58 user nova-compute[75244]:   </os>
Nov 29 23:05:58 user nova-compute[75244]:   <features>
Nov 29 23:05:58 user nova-compute[75244]:     <acpi/>
Nov 29 23:05:58 user nova-compute[75244]:     <apic/>
Nov 29 23:05:58 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:05:58 user nova-compute[75244]:   </features>
Nov 29 23:05:58 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:05:58 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:05:58 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:05:58 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:05:58 user nova-compute[75244]:   </clock>
Nov 29 23:05:58 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:05:58 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:05:58 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:05:58 user nova-compute[75244]:   </cpu>
Nov 29 23:05:58 user nova-compute[75244]:   <devices>
Nov 29 23:05:58 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:05:58 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:05:58 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk"/>
Nov 29 23:05:58 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:05:58 user nova-compute[75244]:     </disk>
Nov 29 23:05:58 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:05:58 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:05:58 user nova-compute[75244]:       <source dev="/dev/sdd"/>
Nov 29 23:05:58 user nova-compute[75244]:       <target dev="vdc" bus="virtio"/>
Nov 29 23:05:58 user nova-compute[75244]:       <serial>57d70862-7a8b-47b5-8aaf-9af1df5a579e</serial>
Nov 29 23:05:58 user nova-compute[75244]:     </disk>
Nov 29 23:05:58 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:05:58 user nova-compute[75244]:       <mac address="fa:16:3e:a3:28:f0"/>
Nov 29 23:05:58 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:58 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:05:58 user nova-compute[75244]:       <target dev="tap8309daad-62"/>
Nov 29 23:05:58 user nova-compute[75244]:     </interface>
Nov 29 23:05:58 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:05:58 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/console.log" append="off"/>
Nov 29 23:05:58 user nova-compute[75244]:     </serial>
Nov 29 23:05:58 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:05:58 user nova-compute[75244]:     <video>
Nov 29 23:05:58 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:05:58 user nova-compute[75244]:     </video>
Nov 29 23:05:58 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:05:58 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:05:58 user nova-compute[75244]:     </rng>
Nov 29 23:05:58 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:05:58 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:05:58 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:05:58 user nova-compute[75244]:     </memballoon>
Nov 29 23:05:58 user nova-compute[75244]:   </devices>
Nov 29 23:05:58 user nova-compute[75244]: </domain>
Nov 29 23:05:58 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1788131671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1788131671',id=4,image_ref='46cd4d46-cfb9-4216-b016-2a6230a5b2e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1743157863',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-oyfa3jdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member',shelved_at='2023-11-29T23:03:51.286571',shelved_host='user',shelved_image_id='46cd4d46-cfb9-4216-b016-2a6230a5b2e5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=98d0cfec-ab5d-49a0-a467-f90989f51aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG os_vif [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c41b705-a957-5510-ad37-985a44f13ef7', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8309daad-62, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8309daad-62, col_values=(('qos', UUID('65c2a08c-6f08-45c7-8ce2-cc4605962c6f')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8309daad-62, col_values=(('external_ids', {'iface-id': '8309daad-6231-443d-9aa1-9b46adbc6fea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:28:f0', 'vm-uuid': '98d0cfec-ab5d-49a0-a467-f90989f51aa0'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:05:58 user nova-compute[75244]: INFO os_vif [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62')
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:05:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No VIF found with MAC fa:16:3e:a3:28:f0, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:05:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-6927f1aa-da92-4be1-9f11-1ecc22a60fdf req-f7eaa3c4-dde2-40cd-bc7d-2c566dddcd91 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:05:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6927f1aa-da92-4be1-9f11-1ecc22a60fdf req-f7eaa3c4-dde2-40cd-bc7d-2c566dddcd91 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:05:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6927f1aa-da92-4be1-9f11-1ecc22a60fdf req-f7eaa3c4-dde2-40cd-bc7d-2c566dddcd91 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:05:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6927f1aa-da92-4be1-9f11-1ecc22a60fdf req-f7eaa3c4-dde2-40cd-bc7d-2c566dddcd91 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:05:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-6927f1aa-da92-4be1-9f11-1ecc22a60fdf req-f7eaa3c4-dde2-40cd-bc7d-2c566dddcd91 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:05:59 user nova-compute[75244]: WARNING nova.compute.manager [req-6927f1aa-da92-4be1-9f11-1ecc22a60fdf req-f7eaa3c4-dde2-40cd-bc7d-2c566dddcd91 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state active and task_state None.
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-67648fc9-d322-4e8e-a1b1-66858286e2a9 req-16fc2aad-8291-4dce-97b7-ec6e28f80fb5 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-67648fc9-d322-4e8e-a1b1-66858286e2a9 req-16fc2aad-8291-4dce-97b7-ec6e28f80fb5 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-67648fc9-d322-4e8e-a1b1-66858286e2a9 req-16fc2aad-8291-4dce-97b7-ec6e28f80fb5 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-67648fc9-d322-4e8e-a1b1-66858286e2a9 req-16fc2aad-8291-4dce-97b7-ec6e28f80fb5 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-67648fc9-d322-4e8e-a1b1-66858286e2a9 req-16fc2aad-8291-4dce-97b7-ec6e28f80fb5 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:06:00 user nova-compute[75244]: WARNING nova.compute.manager [req-67648fc9-d322-4e8e-a1b1-66858286e2a9 req-16fc2aad-8291-4dce-97b7-ec6e28f80fb5 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:06:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:06:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance spawned successfully.
Nov 29 23:06:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-1c882261-724b-41f7-a8fb-f062bc8004f3 req-10777c8e-82b3-423e-83e7-efcd1f7e23e2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1c882261-724b-41f7-a8fb-f062bc8004f3 req-10777c8e-82b3-423e-83e7-efcd1f7e23e2 service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1c882261-724b-41f7-a8fb-f062bc8004f3 req-10777c8e-82b3-423e-83e7-efcd1f7e23e2 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1c882261-724b-41f7-a8fb-f062bc8004f3 req-10777c8e-82b3-423e-83e7-efcd1f7e23e2 service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-1c882261-724b-41f7-a8fb-f062bc8004f3 req-10777c8e-82b3-423e-83e7-efcd1f7e23e2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:06:02 user nova-compute[75244]: WARNING nova.compute.manager [req-1c882261-724b-41f7-a8fb-f062bc8004f3 req-10777c8e-82b3-423e-83e7-efcd1f7e23e2 service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 23:06:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a59cee75-8b80-4216-adb5-1bc652b8ea18 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.597s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:06:03 user nova-compute[75244]: INFO nova.compute.claims [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Claim successful on node user
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:06:04 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.policy [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd93ba0909bd44dfae59be5b157cb0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65023bfd4a461fbbc63d2c08d930a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:06:04 user nova-compute[75244]: INFO nova.virt.block_device [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Booting with volume 1c294d3d-4c05-473a-a2dc-95a642351df8 at /dev/vda
Nov 29 23:06:04 user nova-compute[75244]: DEBUG os_brick.utils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d639a6e0-bdfc-44be-a67c-02290dce19d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.059s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[541269df-228f-4ab0-98c5-e3e0849c40de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c26a52-63e6-401a-9d67-16158a420852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf007d10-3bd7-4605-9ddd-d3d9573209d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:06:04 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:06:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f35a6-93db-455f-ada2-f1b2c785ca63]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG os_brick.utils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== get_connector_properties: return (227ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:06:04 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating existing volume attachment record: da260032-61eb-497d-96be-4bdbade56387 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Successfully created port: 475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBgbycEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:06:05 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:05 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:05 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:06:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c65cf3f-0d04-4a82-90cd-0a2030a80fbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:06:05 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb46abc-c910-40af-b3b6-a8657599df42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34] added
Nov 29 23:06:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fb5f02-ac31-4930-a50b-bb22f9502565]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea7cb0-3f89-4d6e-8635-e995c16ed22e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBgbycEq {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBgbycEq" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc4dc0-732d-4036-9d15-471c67a33bef]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBgbycEq'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[24220526-bb5d-4736-a715-331a57a9a5dd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44936ce-3744-4cb0-b0c3-695bdf411fc0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Successfully updated port: 475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquired lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfbc13c-373e-469c-9cb5-61531a782cc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260]
Nov 29 23:06:06 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260] successful.
Nov 29 23:06:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-changed-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Refreshing instance network info cache due to event network-changed-475156ec-7744-46e6-95f8-9703c9f6f777. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] Acquiring lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cd990a-4901-4c49-af9a-c0c3994fe0ef]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e947249-e912-419f-93fc-435d842c4b8f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:06 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cbfe92-c8d6-46cc-bf1e-df6595afb959]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating instance_info_cache with network_info: [{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Releasing lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance network_info: |[{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] Acquired lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:06:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Refreshing network info cache for port 475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updated VIF entry in instance network info cache for port 475156ec-7744-46e6-95f8-9703c9f6f777. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating instance_info_cache with network_info: [{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a47666b9-5c9f-4304-b16f-ce7428e27992 req-9bc3629f-6614-4b03-a2ba-2c4062596cc5 service nova] Releasing lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBgbycEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23965316663366134', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965316663366134', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.objects.instance [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lazy-loading 'flavor' on Instance uuid d659418e-64fb-4c3e-9569-7011295c252b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:06:07 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:06:07 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:06:07 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:06:07 user nova-compute[75244]:   <serial>4888ed68-2d2c-49f5-a6b3-9ab4da51ea34</serial>
Nov 29 23:06:07 user nova-compute[75244]: </disk>
Nov 29 23:06:07 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:06:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] No VIF found with MAC fa:16:3e:6c:c6:b4, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:06:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3b2b9a0e-790b-4dca-afb3-1a6bdd7959b3 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.586s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:10 user nova-compute[75244]: INFO nova.compute.manager [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Detaching volume 4888ed68-2d2c-49f5-a6b3-9ab4da51ea34
Nov 29 23:06:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:10 user nova-compute[75244]: INFO nova.virt.block_device [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Attempting to driver detach volume 4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 from mountpoint /dev/vdb
Nov 29 23:06:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Attempting to detach device vdb from instance d659418e-64fb-4c3e-9569-7011295c252b from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:06:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:06:10 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:06:10 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:06:10 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:06:10 user nova-compute[75244]:   <serial>4888ed68-2d2c-49f5-a6b3-9ab4da51ea34</serial>
Nov 29 23:06:10 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:06:10 user nova-compute[75244]: </disk>
Nov 29 23:06:10 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:06:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Successfully detached device vdb from instance d659418e-64fb-4c3e-9569-7011295c252b from the persistent domain config.
Nov 29 23:06:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d659418e-64fb-4c3e-9569-7011295c252b from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:06:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:06:10 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:06:10 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:06:10 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:06:10 user nova-compute[75244]:   <serial>4888ed68-2d2c-49f5-a6b3-9ab4da51ea34</serial>
Nov 29 23:06:10 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:06:10 user nova-compute[75244]: </disk>
Nov 29 23:06:10 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:06:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d659418e-64fb-4c3e-9569-7011295c252b {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:06:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:06:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Creating image(s)
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Ensure instance console log exists: /opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Start _get_guest_xml network_info=[{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f285c6d6-ccb5-419a-94df-0d608f08c33c', 'attached_at': '', 'detached_at': '', 'volume_id': '1c294d3d-4c05-473a-a2dc-95a642351df8', 'serial': '1c294d3d-4c05-473a-a2dc-95a642351df8'}, 'attachment_id': 'da260032-61eb-497d-96be-4bdbade56387', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:06:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:06:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:06:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:14 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1627ed8-29d4-4684-9e55-80fec2e76b4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:06:14 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7b9efe-41f9-421a-be2f-2e1ca927daf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8] added
Nov 29 23:06:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e468d4-12ca-4a24-85d9-f5993fef393d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7e5f40-cef6-4bdd-aa5c-a508a1c97214]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCRYaZwx {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCRYaZwx" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96c7177-f957-4dbe-bdc8-163a73b858c5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCRYaZwx'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c805459-10d0-4a4c-bfaa-7d63c4732d67]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[10998229-9853-4b63-9c28-bcb7a5d67e0b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --login" returned: 0 in 0.223s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b00c4-1543-4cd3-85e7-e5e7d91b4bfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]
Nov 29 23:06:14 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.
Nov 29 23:06:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[51005850-e7f0-4bff-bdf2-6e5fa4339171]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8883277c-12e0-4623-aca3-a2fe638264f1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.490s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ae4fc-ac49-4394-90f0-24d62336722b]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:06:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:06:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.531s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== connect_volume: return (1532ms) {'type': 'block', 'scsi_wwn': '23330336537326332', 'path': '/dev/sdf'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:06:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330336537326332', 'path': '/dev/sdf'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1038057022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1038057022',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5E3Tsq5bbF9bdpJnsYkIAIienF8hmPQXzNUhNp2gKZCBRd+lp43mKtu7gxh++Wp6Li9ezdn0RmsDzgcwlFYEzAWJqfRjy5edd4uf7DcDG3fiiq9ZHensfgVJTB4AOg==',key_name='tempest-keypair-637915247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c65023bfd4a461fbbc63d2c08d930a8',ramdisk_id='',reservation_id='r-br52rfyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-439423886',owner_user_name='tempest-ServerActionsV293TestJSON-439423886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd93ba0909bd44dfae59be5b157cb0cf',uuid=f285c6d6-ccb5-419a-94df-0d608f08c33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converting VIF {"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lazy-loading 'pci_devices' on Instance uuid f285c6d6-ccb5-419a-94df-0d608f08c33c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:06:16 user nova-compute[75244]:   <uuid>f285c6d6-ccb5-419a-94df-0d608f08c33c</uuid>
Nov 29 23:06:16 user nova-compute[75244]:   <name>instance-00000010</name>
Nov 29 23:06:16 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:06:16 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:06:16 user nova-compute[75244]:   <metadata>
Nov 29 23:06:16 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:06:16 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:06:16 user nova-compute[75244]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1038057022</nova:name>
Nov 29 23:06:16 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:06:14</nova:creationTime>
Nov 29 23:06:16 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:06:16 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:06:16 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:06:16 user nova-compute[75244]:       <nova:owner>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:user uuid="dd93ba0909bd44dfae59be5b157cb0cf">tempest-ServerActionsV293TestJSON-439423886-project-member</nova:user>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:project uuid="7c65023bfd4a461fbbc63d2c08d930a8">tempest-ServerActionsV293TestJSON-439423886</nova:project>
Nov 29 23:06:16 user nova-compute[75244]:       </nova:owner>
Nov 29 23:06:16 user nova-compute[75244]:       <nova:ports>
Nov 29 23:06:16 user nova-compute[75244]:         <nova:port uuid="475156ec-7744-46e6-95f8-9703c9f6f777">
Nov 29 23:06:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 23:06:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:06:16 user nova-compute[75244]:       </nova:ports>
Nov 29 23:06:16 user nova-compute[75244]:     </nova:instance>
Nov 29 23:06:16 user nova-compute[75244]:   </metadata>
Nov 29 23:06:16 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:06:16 user nova-compute[75244]:     <system>
Nov 29 23:06:16 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:06:16 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:06:16 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:06:16 user nova-compute[75244]:       <entry name="serial">f285c6d6-ccb5-419a-94df-0d608f08c33c</entry>
Nov 29 23:06:16 user nova-compute[75244]:       <entry name="uuid">f285c6d6-ccb5-419a-94df-0d608f08c33c</entry>
Nov 29 23:06:16 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:06:16 user nova-compute[75244]:     </system>
Nov 29 23:06:16 user nova-compute[75244]:   </sysinfo>
Nov 29 23:06:16 user nova-compute[75244]:   <os>
Nov 29 23:06:16 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:06:16 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:06:16 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:06:16 user nova-compute[75244]:   </os>
Nov 29 23:06:16 user nova-compute[75244]:   <features>
Nov 29 23:06:16 user nova-compute[75244]:     <acpi/>
Nov 29 23:06:16 user nova-compute[75244]:     <apic/>
Nov 29 23:06:16 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:06:16 user nova-compute[75244]:   </features>
Nov 29 23:06:16 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:06:16 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:06:16 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:06:16 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:06:16 user nova-compute[75244]:   </clock>
Nov 29 23:06:16 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:06:16 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:06:16 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:06:16 user nova-compute[75244]:   </cpu>
Nov 29 23:06:16 user nova-compute[75244]:   <devices>
Nov 29 23:06:16 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:06:16 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:06:16 user nova-compute[75244]:       <source dev="/dev/sdf"/>
Nov 29 23:06:16 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:06:16 user nova-compute[75244]:       <serial>1c294d3d-4c05-473a-a2dc-95a642351df8</serial>
Nov 29 23:06:16 user nova-compute[75244]:     </disk>
Nov 29 23:06:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:06:16 user nova-compute[75244]:       <mac address="fa:16:3e:39:ab:a5"/>
Nov 29 23:06:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:06:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:06:16 user nova-compute[75244]:       <target dev="tap475156ec-77"/>
Nov 29 23:06:16 user nova-compute[75244]:     </interface>
Nov 29 23:06:16 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:06:16 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c/console.log" append="off"/>
Nov 29 23:06:16 user nova-compute[75244]:     </serial>
Nov 29 23:06:16 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:06:16 user nova-compute[75244]:     <video>
Nov 29 23:06:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:06:16 user nova-compute[75244]:     </video>
Nov 29 23:06:16 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:06:16 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:06:16 user nova-compute[75244]:     </rng>
Nov 29 23:06:16 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:06:16 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:06:16 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:06:16 user nova-compute[75244]:     </memballoon>
Nov 29 23:06:16 user nova-compute[75244]:   </devices>
Nov 29 23:06:16 user nova-compute[75244]: </domain>
Nov 29 23:06:16 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1038057022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1038057022',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5E3Tsq5bbF9bdpJnsYkIAIienF8hmPQXzNUhNp2gKZCBRd+lp43mKtu7gxh++Wp6Li9ezdn0RmsDzgcwlFYEzAWJqfRjy5edd4uf7DcDG3fiiq9ZHensfgVJTB4AOg==',key_name='tempest-keypair-637915247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c65023bfd4a461fbbc63d2c08d930a8',ramdisk_id='',reservation_id='r-br52rfyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-439423886',owner_user_name='tempest-ServerActionsV293TestJSON-439423886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd93ba0909bd44dfae59be5b157cb0cf',uuid=f285c6d6-ccb5-419a-94df-0d608f08c33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converting VIF {"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG os_vif [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ece7265-a62a-5370-9544-e01ae6501a8b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap475156ec-77, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap475156ec-77, col_values=(('qos', UUID('8e8919f6-3353-4bf0-adc4-bec0f5f71b98')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap475156ec-77, col_values=(('external_ids', {'iface-id': '475156ec-7744-46e6-95f8-9703c9f6f777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ab:a5', 'vm-uuid': 'f285c6d6-ccb5-419a-94df-0d608f08c33c'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:16 user nova-compute[75244]: INFO os_vif [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77')
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:06:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] No VIF found with MAC fa:16:3e:39:ab:a5, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-0353d6cb-0a1d-445d-b7ff-5c0815c7a6d8 req-735b2ef4-d9a5-4881-a80d-212fd6e0e6de service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0353d6cb-0a1d-445d-b7ff-5c0815c7a6d8 req-735b2ef4-d9a5-4881-a80d-212fd6e0e6de service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0353d6cb-0a1d-445d-b7ff-5c0815c7a6d8 req-735b2ef4-d9a5-4881-a80d-212fd6e0e6de service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0353d6cb-0a1d-445d-b7ff-5c0815c7a6d8 req-735b2ef4-d9a5-4881-a80d-212fd6e0e6de service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-0353d6cb-0a1d-445d-b7ff-5c0815c7a6d8 req-735b2ef4-d9a5-4881-a80d-212fd6e0e6de service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:06:17 user nova-compute[75244]: WARNING nova.compute.manager [req-0353d6cb-0a1d-445d-b7ff-5c0815c7a6d8 req-735b2ef4-d9a5-4881-a80d-212fd6e0e6de service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state building and task_state spawning.
Nov 29 23:06:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:06:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance spawned successfully.
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-7db21061-7532-4e9b-b2ca-575a7f6fe57a req-3ffabdb9-10bf-4f9c-99ab-7b6facce5038 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7db21061-7532-4e9b-b2ca-575a7f6fe57a req-3ffabdb9-10bf-4f9c-99ab-7b6facce5038 service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7db21061-7532-4e9b-b2ca-575a7f6fe57a req-3ffabdb9-10bf-4f9c-99ab-7b6facce5038 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7db21061-7532-4e9b-b2ca-575a7f6fe57a req-3ffabdb9-10bf-4f9c-99ab-7b6facce5038 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-7db21061-7532-4e9b-b2ca-575a7f6fe57a req-3ffabdb9-10bf-4f9c-99ab-7b6facce5038 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:06:19 user nova-compute[75244]: WARNING nova.compute.manager [req-7db21061-7532-4e9b-b2ca-575a7f6fe57a req-3ffabdb9-10bf-4f9c-99ab-7b6facce5038 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state building and task_state spawning.
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:06:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:06:20 user nova-compute[75244]: INFO nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 29 23:06:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:06:20 user nova-compute[75244]: INFO nova.compute.manager [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Took 16.41 seconds to build instance.
Nov 29 23:06:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-17d3e619-e2ac-4f8b-95b3-1dd6d4d54c22 tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.515s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d659418e-64fb-4c3e-9569-7011295c252b is timed out.
Nov 29 23:06:30 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Successfully detached device vdb from instance d659418e-64fb-4c3e-9569-7011295c252b from the live domain config.
Nov 29 23:06:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBgbycEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:06:30 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf43ea-4330-49c9-bae0-ec500d69a93d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:06:30 user nova-compute[75244]: No targets found.
Nov 29 23:06:30 user nova-compute[75244]: iSNS:
Nov 29 23:06:30 user nova-compute[75244]: No targets found.
Nov 29 23:06:30 user nova-compute[75244]: STATIC:
Nov 29 23:06:30 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e
Nov 29 23:06:30 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:06:30 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:06:30 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:06:30 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:06:30 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:06:30 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34
Nov 29 23:06:30 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:06:30 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:06:30 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:06:30 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:06:30 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:06:30 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03
Nov 29 23:06:30 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:06:30 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:06:30 user nova-compute[75244]: FIRMWARE:
Nov 29 23:06:30 user nova-compute[75244]: No targets found.
Nov 29 23:06:30 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:06:30 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:06:30 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f8b0b-63ac-4e72-8649-45efd033d660]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ab3a9-b41d-46e4-8c9c-d9f226355e82]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:30 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 (non-flash)
Nov 29 23:06:30 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:30 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed2b24-b28d-46ec-aba7-31478a08fad0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d797208-df41-4555-8c49-58d5648358c1]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7a2f7-b4e6-4635-a10e-eb5ad014dd63]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec362c07-4117-474e-b65f-e170924a2c4c]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:06:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7046c1ad-3e2a-4148-9da1-5233d92e27dd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edf0e1-b39a-40db-9225-31e144c7b7d5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260]
Nov 29 23:06:31 user nova-compute[75244]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34, portal: 172.16.0.220,3260] successful.
Nov 29 23:06:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4888ed68-2d2c-49f5-a6b3-9ab4da51ea34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7aff1d-7705-4f1a-b61a-444f5d610013]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] <== disconnect_volume: return (352ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:06:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:06:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.409s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lazy-loading 'flavor' on Instance uuid d659418e-64fb-4c3e-9569-7011295c252b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:06:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:06:36 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:06:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=25.352508544921875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8e77561f-a707-44ef-839a-b21996e57b96 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.777s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f2b866e9-d721-494e-b4ce-9605047d87de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance d659418e-64fb-4c3e-9569-7011295c252b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b8ceea92-f765-46a7-8851-3bdacb386732 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f285c6d6-ccb5-419a-94df-0d608f08c33c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:06:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:06:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:06:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-changed-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Refreshing instance network info cache due to event network-changed-39466e90-10cb-4540-bd33-8ef69252ced7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:06:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] Acquiring lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:06:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] Acquired lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:06:41 user nova-compute[75244]: DEBUG nova.network.neutron [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Refreshing network info cache for port 39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:06:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updated VIF entry in instance network info cache for port 39466e90-10cb-4540-bd33-8ef69252ced7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:06:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating instance_info_cache with network_info: [{"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:06:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b641f464-010f-4009-a4b1-429ad9f6d174 req-013f5520-d307-4912-91e7-a7f53295341f service nova] Releasing lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:06:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG nova.objects.instance [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:44 user nova-compute[75244]: INFO nova.compute.manager [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Attaching volume 6858b275-9dd6-47b8-b60a-cdf1eae8281a to /dev/vdb
Nov 29 23:06:44 user nova-compute[75244]: DEBUG os_brick.utils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a14288-b65e-4e6e-8f90-a85a1fb83683]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84039e8-f858-45ab-a88e-14d67a482a7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8a613-0bca-48aa-8ad9-4afc458516c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f5e15-3af0-4c82-b839-081137504635]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:06:44 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:06:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[24707f5d-b462-4d2d-b341-b560b120a37d]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG os_brick.utils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:06:44 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating existing volume attachment record: 66a9d80c-a21e-44ed-a549-afd081e124be {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:06:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOGdCtYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:06:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:06:53 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8955f-2346-4294-9480-63d7ca1e1eaa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:06:53 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9373f1-a5cb-4bd7-b2e4-413276ef0c4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a] added
Nov 29 23:06:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c5cd62-0639-4672-92d2-e25962e626bf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d683f2-1d58-4d28-a459-b7c4283435e0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOGdCtYb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOGdCtYb" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[da159f6a-811d-4d20-a208-5f48911f94a7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOGdCtYb'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee32fab-36fe-4cbf-ab9c-e2e7d6034d31]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703db2d-dc69-48b3-a596-0b384ff5f6e3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:53 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:53 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:53 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:53 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:53 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:53 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0436f574-1c2e-4ecc-8f51-75874ebc836a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260]
Nov 29 23:06:53 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260] successful.
Nov 29 23:06:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ec998-a05d-4fbf-9ac0-552d6f9d7762]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e8e18-c8be-4dc6-976a-e2d874ce2e63]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:06:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:06:54 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:06:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4105be7e-141e-439c-9297-a13fd109a988]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:06:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOGdCtYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23461363866373662', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461363866373662', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.objects.instance [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:06:55 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:06:55 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:06:55 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:06:55 user nova-compute[75244]:   <serial>6858b275-9dd6-47b8-b60a-cdf1eae8281a</serial>
Nov 29 23:06:55 user nova-compute[75244]: </disk>
Nov 29 23:06:55 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:06:55 user nova-compute[75244]: INFO nova.compute.claims [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Claim successful on node user
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:e8:44:ef, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3c2ee284-f667-46ad-b441-874adf83785d tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.061s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:06:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:06:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.policy [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2a16d9d8a414de4b6621acd12b89aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9595b50731fc44ae85e99ded8dbbaf61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:06:56 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Creating image(s)
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.222s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk 1073741824" returned: 0 in 0.056s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Successfully created port: e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.227s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Cannot resize image /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Ensure instance console log exists: /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Successfully updated port: e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-changed-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Refreshing instance network info cache due to event network-changed-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] Acquiring lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Instance network_info: |[{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] Acquired lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Refreshing network info cache for port e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Start _get_guest_xml network_info=[{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:06:57 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:06:57 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-326757774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-326757774',id=17,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-w22nykf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:06:56Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=a8d0a398-f622-4593-b24e-9be42debfa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:06:57 user nova-compute[75244]: DEBUG nova.objects.instance [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'pci_devices' on Instance uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:06:58 user nova-compute[75244]:   <uuid>a8d0a398-f622-4593-b24e-9be42debfa28</uuid>
Nov 29 23:06:58 user nova-compute[75244]:   <name>instance-00000011</name>
Nov 29 23:06:58 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:06:58 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:06:58 user nova-compute[75244]:   <metadata>
Nov 29 23:06:58 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:06:58 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:06:58 user nova-compute[75244]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-326757774</nova:name>
Nov 29 23:06:58 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:06:57</nova:creationTime>
Nov 29 23:06:58 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:06:58 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:06:58 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:06:58 user nova-compute[75244]:       <nova:owner>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:user uuid="c2a16d9d8a414de4b6621acd12b89aa0">tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member</nova:user>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:project uuid="9595b50731fc44ae85e99ded8dbbaf61">tempest-ServerBootFromVolumeStableRescueTest-1262475948</nova:project>
Nov 29 23:06:58 user nova-compute[75244]:       </nova:owner>
Nov 29 23:06:58 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:06:58 user nova-compute[75244]:       <nova:ports>
Nov 29 23:06:58 user nova-compute[75244]:         <nova:port uuid="e8b538c9-f565-459f-bdb5-ffeed0d2c1d4">
Nov 29 23:06:58 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:06:58 user nova-compute[75244]:         </nova:port>
Nov 29 23:06:58 user nova-compute[75244]:       </nova:ports>
Nov 29 23:06:58 user nova-compute[75244]:     </nova:instance>
Nov 29 23:06:58 user nova-compute[75244]:   </metadata>
Nov 29 23:06:58 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:06:58 user nova-compute[75244]:     <system>
Nov 29 23:06:58 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:06:58 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:06:58 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:06:58 user nova-compute[75244]:       <entry name="serial">a8d0a398-f622-4593-b24e-9be42debfa28</entry>
Nov 29 23:06:58 user nova-compute[75244]:       <entry name="uuid">a8d0a398-f622-4593-b24e-9be42debfa28</entry>
Nov 29 23:06:58 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:06:58 user nova-compute[75244]:     </system>
Nov 29 23:06:58 user nova-compute[75244]:   </sysinfo>
Nov 29 23:06:58 user nova-compute[75244]:   <os>
Nov 29 23:06:58 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:06:58 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:06:58 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:06:58 user nova-compute[75244]:   </os>
Nov 29 23:06:58 user nova-compute[75244]:   <features>
Nov 29 23:06:58 user nova-compute[75244]:     <acpi/>
Nov 29 23:06:58 user nova-compute[75244]:     <apic/>
Nov 29 23:06:58 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:06:58 user nova-compute[75244]:   </features>
Nov 29 23:06:58 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:06:58 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:06:58 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:06:58 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:06:58 user nova-compute[75244]:   </clock>
Nov 29 23:06:58 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:06:58 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:06:58 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:06:58 user nova-compute[75244]:   </cpu>
Nov 29 23:06:58 user nova-compute[75244]:   <devices>
Nov 29 23:06:58 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:06:58 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:06:58 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk"/>
Nov 29 23:06:58 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:06:58 user nova-compute[75244]:     </disk>
Nov 29 23:06:58 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:06:58 user nova-compute[75244]:       <mac address="fa:16:3e:e2:84:e1"/>
Nov 29 23:06:58 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:06:58 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:06:58 user nova-compute[75244]:       <target dev="tape8b538c9-f5"/>
Nov 29 23:06:58 user nova-compute[75244]:     </interface>
Nov 29 23:06:58 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:06:58 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/console.log" append="off"/>
Nov 29 23:06:58 user nova-compute[75244]:     </serial>
Nov 29 23:06:58 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:06:58 user nova-compute[75244]:     <video>
Nov 29 23:06:58 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:06:58 user nova-compute[75244]:     </video>
Nov 29 23:06:58 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:06:58 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:06:58 user nova-compute[75244]:     </rng>
Nov 29 23:06:58 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:06:58 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:06:58 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:06:58 user nova-compute[75244]:     </memballoon>
Nov 29 23:06:58 user nova-compute[75244]:   </devices>
Nov 29 23:06:58 user nova-compute[75244]: </domain>
Nov 29 23:06:58 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-326757774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-326757774',id=17,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-w22nykf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:06:56Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=a8d0a398-f622-4593-b24e-9be42debfa28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG os_vif [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98e01947-0285-5301-b976-0faba679a1f5', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b538c9-f5, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8b538c9-f5, col_values=(('qos', UUID('fe8e5327-1248-4b1d-8801-b5b858538729')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8b538c9-f5, col_values=(('external_ids', {'iface-id': 'e8b538c9-f565-459f-bdb5-ffeed0d2c1d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:84:e1', 'vm-uuid': 'a8d0a398-f622-4593-b24e-9be42debfa28'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:58 user nova-compute[75244]: INFO os_vif [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5')
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No VIF found with MAC fa:16:3e:e2:84:e1, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updated VIF entry in instance network info cache for port e8b538c9-f565-459f-bdb5-ffeed0d2c1d4. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29e32d18-3fc7-47e4-bb4a-1541ce014d69 req-ae5ea7e8-44b5-4595-9d18-7e51aa391493 service nova] Releasing lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:06:59 user nova-compute[75244]: INFO nova.compute.claims [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Claim successful on node user
Nov 29 23:06:59 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:06:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:06:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:07:00 user nova-compute[75244]: INFO nova.virt.block_device [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Booting with volume 5f93a5a6-4148-4752-989d-7d4909a3c7f0 at /dev/vda
Nov 29 23:07:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG os_brick.utils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b23e3f-57c3-4f48-87aa-35b6429ccd01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.policy [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eba8741256384b64a7f789c9601a9ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1036182cd9b4ce98f5c43b312c4ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d906d53d-adba-45eb-a5d7-583d96dd1e03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc30d7c-49f9-4317-8991-c6913669750c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a701f18e-9423-4e55-96fe-c77bd4deb667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:07:00 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2e80d-bb5e-40b2-9fd2-c4923df929e3]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG os_brick.utils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== get_connector_properties: return (257ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating existing volume attachment record: 619f8b48-cd59-4e3d-a5e0-a426097b7d35 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-f3869fb9-754b-4a74-b19e-fb8583f0eb0a req-8bb90d38-64c6-4e3d-86ba-9bd0ff52af60 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f3869fb9-754b-4a74-b19e-fb8583f0eb0a req-8bb90d38-64c6-4e3d-86ba-9bd0ff52af60 service nova] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f3869fb9-754b-4a74-b19e-fb8583f0eb0a req-8bb90d38-64c6-4e3d-86ba-9bd0ff52af60 service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f3869fb9-754b-4a74-b19e-fb8583f0eb0a req-8bb90d38-64c6-4e3d-86ba-9bd0ff52af60 service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-f3869fb9-754b-4a74-b19e-fb8583f0eb0a req-8bb90d38-64c6-4e3d-86ba-9bd0ff52af60 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] No waiting events found dispatching network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:00 user nova-compute[75244]: WARNING nova.compute.manager [req-f3869fb9-754b-4a74-b19e-fb8583f0eb0a req-8bb90d38-64c6-4e3d-86ba-9bd0ff52af60 service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received unexpected event network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 for instance with vm_state building and task_state spawning.
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:00 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:07:00 user nova-compute[75244]: INFO nova.compute.claims [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Claim successful on node user
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully created port: d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:07:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.policy [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbdba67b1fdb470194c5a15ee3c4baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f830c5f8f3641f1938b103eae582ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:07:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Creating image(s)
Nov 29 23:07:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "/opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully created port: 93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk 1073741824" returned: 0 in 0.119s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Successfully created port: c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-96aaf076-9586-4776-b1ac-b23990e0452b req-ce2c670b-203c-4b15-ad2e-a62cf121c59d service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-96aaf076-9586-4776-b1ac-b23990e0452b req-ce2c670b-203c-4b15-ad2e-a62cf121c59d service nova] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-96aaf076-9586-4776-b1ac-b23990e0452b req-ce2c670b-203c-4b15-ad2e-a62cf121c59d service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-96aaf076-9586-4776-b1ac-b23990e0452b req-ce2c670b-203c-4b15-ad2e-a62cf121c59d service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-96aaf076-9586-4776-b1ac-b23990e0452b req-ce2c670b-203c-4b15-ad2e-a62cf121c59d service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] No waiting events found dispatching network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:02 user nova-compute[75244]: WARNING nova.compute.manager [req-96aaf076-9586-4776-b1ac-b23990e0452b req-ce2c670b-203c-4b15-ad2e-a62cf121c59d service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received unexpected event network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 for instance with vm_state building and task_state spawning.
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:07:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Instance spawned successfully.
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Cannot resize image /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Ensure instance console log exists: /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:03 user nova-compute[75244]: INFO nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Took 6.95 seconds to spawn the instance on the hypervisor.
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:03 user nova-compute[75244]: INFO nova.compute.manager [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Took 7.83 seconds to build instance.
Nov 29 23:07:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d1357fc1-97be-493d-838f-8b1576a85763 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.937s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully created port: 071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Successfully updated port: c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquired lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-changed-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Refreshing instance network info cache due to event network-changed-c94c3e52-300f-4b5f-8942-08c95eab4cfe. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] Acquiring lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.network.neutron [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Updating instance_info_cache with network_info: [{"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Releasing lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Instance network_info: |[{"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] Acquired lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Refreshing network info cache for port c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Start _get_guest_xml network_info=[{"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:07:03 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:07:03 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:07:03 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1647620043',display_name='tempest-AttachVolumeNegativeTest-server-1647620043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1647620043',id=19,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3mVp8481JgMG0yfKd75PNdZ3+iGAqBUz9KoDilGi1F/oUQCjIdjV8bbQ1UKL9O41msQwqcJ4mN+KO4Bgn/Hyc+XeevLI5ULbzqtnGiR0tUbsWRsaUgazllsUzNV6mX3g==',key_name='tempest-keypair-125789724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-xw0m9vmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=49d04f90-df1c-4cfb-84d5-8759a5871796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'pci_devices' on Instance uuid 49d04f90-df1c-4cfb-84d5-8759a5871796 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:07:04 user nova-compute[75244]:   <uuid>49d04f90-df1c-4cfb-84d5-8759a5871796</uuid>
Nov 29 23:07:04 user nova-compute[75244]:   <name>instance-00000013</name>
Nov 29 23:07:04 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:07:04 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:07:04 user nova-compute[75244]:   <metadata>
Nov 29 23:07:04 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:07:04 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:07:04 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1647620043</nova:name>
Nov 29 23:07:04 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:07:03</nova:creationTime>
Nov 29 23:07:04 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:07:04 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:07:04 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:07:04 user nova-compute[75244]:       <nova:owner>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:user uuid="dbdba67b1fdb470194c5a15ee3c4baee">tempest-AttachVolumeNegativeTest-750809743-project-member</nova:user>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:project uuid="2f830c5f8f3641f1938b103eae582ccd">tempest-AttachVolumeNegativeTest-750809743</nova:project>
Nov 29 23:07:04 user nova-compute[75244]:       </nova:owner>
Nov 29 23:07:04 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:07:04 user nova-compute[75244]:       <nova:ports>
Nov 29 23:07:04 user nova-compute[75244]:         <nova:port uuid="c94c3e52-300f-4b5f-8942-08c95eab4cfe">
Nov 29 23:07:04 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:07:04 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:04 user nova-compute[75244]:       </nova:ports>
Nov 29 23:07:04 user nova-compute[75244]:     </nova:instance>
Nov 29 23:07:04 user nova-compute[75244]:   </metadata>
Nov 29 23:07:04 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:07:04 user nova-compute[75244]:     <system>
Nov 29 23:07:04 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:07:04 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:07:04 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:07:04 user nova-compute[75244]:       <entry name="serial">49d04f90-df1c-4cfb-84d5-8759a5871796</entry>
Nov 29 23:07:04 user nova-compute[75244]:       <entry name="uuid">49d04f90-df1c-4cfb-84d5-8759a5871796</entry>
Nov 29 23:07:04 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:07:04 user nova-compute[75244]:     </system>
Nov 29 23:07:04 user nova-compute[75244]:   </sysinfo>
Nov 29 23:07:04 user nova-compute[75244]:   <os>
Nov 29 23:07:04 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:07:04 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:07:04 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:07:04 user nova-compute[75244]:   </os>
Nov 29 23:07:04 user nova-compute[75244]:   <features>
Nov 29 23:07:04 user nova-compute[75244]:     <acpi/>
Nov 29 23:07:04 user nova-compute[75244]:     <apic/>
Nov 29 23:07:04 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:07:04 user nova-compute[75244]:   </features>
Nov 29 23:07:04 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:07:04 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:07:04 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:07:04 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:07:04 user nova-compute[75244]:   </clock>
Nov 29 23:07:04 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:07:04 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:07:04 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:07:04 user nova-compute[75244]:   </cpu>
Nov 29 23:07:04 user nova-compute[75244]:   <devices>
Nov 29 23:07:04 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:07:04 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:07:04 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk"/>
Nov 29 23:07:04 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:07:04 user nova-compute[75244]:     </disk>
Nov 29 23:07:04 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:04 user nova-compute[75244]:       <mac address="fa:16:3e:b9:ea:57"/>
Nov 29 23:07:04 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:04 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:04 user nova-compute[75244]:       <target dev="tapc94c3e52-30"/>
Nov 29 23:07:04 user nova-compute[75244]:     </interface>
Nov 29 23:07:04 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:07:04 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/console.log" append="off"/>
Nov 29 23:07:04 user nova-compute[75244]:     </serial>
Nov 29 23:07:04 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:07:04 user nova-compute[75244]:     <video>
Nov 29 23:07:04 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:04 user nova-compute[75244]:     </video>
Nov 29 23:07:04 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:07:04 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:07:04 user nova-compute[75244]:     </rng>
Nov 29 23:07:04 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:07:04 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:07:04 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:07:04 user nova-compute[75244]:     </memballoon>
Nov 29 23:07:04 user nova-compute[75244]:   </devices>
Nov 29 23:07:04 user nova-compute[75244]: </domain>
Nov 29 23:07:04 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1647620043',display_name='tempest-AttachVolumeNegativeTest-server-1647620043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1647620043',id=19,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3mVp8481JgMG0yfKd75PNdZ3+iGAqBUz9KoDilGi1F/oUQCjIdjV8bbQ1UKL9O41msQwqcJ4mN+KO4Bgn/Hyc+XeevLI5ULbzqtnGiR0tUbsWRsaUgazllsUzNV6mX3g==',key_name='tempest-keypair-125789724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-xw0m9vmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=49d04f90-df1c-4cfb-84d5-8759a5871796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG os_vif [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcfb6680-7732-59e0-8c72-e94336ec4112', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully created port: 5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc94c3e52-30, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc94c3e52-30, col_values=(('qos', UUID('1788144b-ea45-454f-9819-909c53fc3b9e')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc94c3e52-30, col_values=(('external_ids', {'iface-id': 'c94c3e52-300f-4b5f-8942-08c95eab4cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ea:57', 'vm-uuid': '49d04f90-df1c-4cfb-84d5-8759a5871796'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: INFO os_vif [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30')
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:04 user nova-compute[75244]: INFO nova.compute.manager [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Terminating instance
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:b9:ea:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.neutron [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Updated VIF entry in instance network info cache for port c94c3e52-300f-4b5f-8942-08c95eab4cfe. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.network.neutron [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Updating instance_info_cache with network_info: [{"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2361e294-2ba1-4b9c-b91b-97d9b3ef0889 req-20080e17-6ae0-4f77-8c7c-7b2b88b99430 service nova] Releasing lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-c382e7c3-04ef-44ea-871d-f31a077f73c4 req-f0ddeaaa-6270-4bff-85e5-4a5b10970297 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-unplugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c382e7c3-04ef-44ea-871d-f31a077f73c4 req-f0ddeaaa-6270-4bff-85e5-4a5b10970297 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c382e7c3-04ef-44ea-871d-f31a077f73c4 req-f0ddeaaa-6270-4bff-85e5-4a5b10970297 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c382e7c3-04ef-44ea-871d-f31a077f73c4 req-f0ddeaaa-6270-4bff-85e5-4a5b10970297 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-c382e7c3-04ef-44ea-871d-f31a077f73c4 req-f0ddeaaa-6270-4bff-85e5-4a5b10970297 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-unplugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-c382e7c3-04ef-44ea-871d-f31a077f73c4 req-f0ddeaaa-6270-4bff-85e5-4a5b10970297 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-unplugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully created port: 56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-d6b7adb2-824f-4381-82ad-8000e7bcc0d6. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Instance destroyed successfully.
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.objects.instance [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'resources' on Instance uuid 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1295376455',display_name='tempest-VolumesAdminNegativeTest-server-1295376455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1295376455',id=15,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa2f1cf1914faa9c73096e1cb1b8e9',ramdisk_id='',reservation_id='r-1z499nob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-778262822',owner_user_name='tempest-VolumesAdminNegativeTest-778262822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:05:12Z,user_data=None,user_id='df0d594179f64f79b1b66cbeea8bac59',uuid=9f153ee8-e8ab-4ea3-9dea-c8cc419956fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converting VIF {"id": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "address": "fa:16:3e:a6:11:a1", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b708ed5-68", "ovs_interfaceid": "5b708ed5-68c2-452f-9909-f2a3543cd16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG os_vif [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b708ed5-68, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e848233-5584-4ec5-be15-f312923e732b) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: INFO os_vif [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:11:a1,bridge_name='br-int',has_traffic_filtering=True,id=5b708ed5-68c2-452f-9909-f2a3543cd16e,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b708ed5-68')
Nov 29 23:07:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Deleting instance files /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc_del
Nov 29 23:07:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Deletion of /opt/stack/data/nova/instances/9f153ee8-e8ab-4ea3-9dea-c8cc419956fc_del complete
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:06 user nova-compute[75244]: INFO nova.compute.manager [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Took 2.23 seconds to destroy the instance on the hypervisor.
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3a0d0b82-5411-4865-b96e-b6e0c50ef2b9 req-bac8aafd-de58-4364-bb5f-f5355ce2efba service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:06 user nova-compute[75244]: WARNING nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received unexpected event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with vm_state active and task_state deleting.
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:06 user nova-compute[75244]: WARNING nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received unexpected event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with vm_state active and task_state deleting.
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:06 user nova-compute[75244]: WARNING nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received unexpected event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with vm_state active and task_state deleting.
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-unplugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-unplugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-unplugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Acquiring lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] No waiting events found dispatching network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:06 user nova-compute[75244]: WARNING nova.compute.manager [req-4636ead4-ed06-49f8-bd57-a4ab417b81a2 req-b136b303-6dde-488f-90fd-82600e71c771 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received unexpected event network-vif-plugged-5b708ed5-68c2-452f-9909-f2a3543cd16e for instance with vm_state active and task_state deleting.
Nov 29 23:07:07 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:07 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Took 0.64 seconds to deallocate network for instance.
Nov 29 23:07:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb1a85f7-8df3-4257-be93-3a6c2012d67a req-9461b6c5-2400-4ef0-a2f4-7f07d3bb3fa0 service nova] [instance: 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc] Received event network-vif-deleted-5b708ed5-68c2-452f-9909-f2a3543cd16e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: 588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:07 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:07:07 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:07:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:07 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Deleted allocations for instance 9f153ee8-e8ab-4ea3-9dea-c8cc419956fc
Nov 29 23:07:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-610f5441-ca97-4c22-bc26-f9476316955b tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "9f153ee8-e8ab-4ea3-9dea-c8cc419956fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.655s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] No waiting events found dispatching network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:08 user nova-compute[75244]: WARNING nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received unexpected event network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe for instance with vm_state building and task_state spawning.
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-588b2724-774c-4898-888a-af320dd4d8a1. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.network.neutron [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port 588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.network.neutron [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: 49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.network.neutron [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:07:08 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Instance spawned successfully.
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] No waiting events found dispatching network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:08 user nova-compute[75244]: WARNING nova.compute.manager [req-d15053bb-b1ae-4b44-9005-a48ff65a4826 req-e3397300-7dbf-4ea3-83b3-e4aed4ed8d9f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received unexpected event network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe for instance with vm_state building and task_state spawning.
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:07:08 user nova-compute[75244]: INFO nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 29 23:07:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:07:08 user nova-compute[75244]: INFO nova.compute.manager [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Took 8.06 seconds to build instance.
Nov 29 23:07:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-992cc1b9-1753-4dc5-a5e2-4daebcf1a86a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.188s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: 93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:09 user nova-compute[75244]: INFO nova.compute.manager [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Terminating instance
Nov 29 23:07:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-49fca043-bdd4-4f8f-9f3d-726404756b6d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port 49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Instance destroyed successfully.
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lazy-loading 'resources' on Instance uuid d659418e-64fb-4c3e-9569-7011295c252b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1417893341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1417893',id=13,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCp3ZSrDQfICWcr+RwWsO7uIk+QWcCsYwEBWXxNaOCR+Bzn54v7N3kFH70uwIHZADRt754FvtXFyfOHJiDar4JsL9lP+TYGGY6D0AkGX10OOCUrsaBNdkYZiPWoL/Qzbw==',key_name='tempest-keypair-482319447',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:04:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d21e9e089edf4ae3b8fcf65f057430e4',ramdisk_id='',reservation_id='r-wnju16a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151225029',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a37f1e31ec04baa970afd3400c6f2b9',uuid=d659418e-64fb-4c3e-9569-7011295c252b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Converting VIF {"id": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "address": "fa:16:3e:6c:c6:b4", "network": {"id": "394006ec-3e89-47a7-8ffa-64d0d7a8cd0d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2035070540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d21e9e089edf4ae3b8fcf65f057430e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2721fa9f-cb", "ovs_interfaceid": "2721fa9f-cbf6-4e2b-979a-e045ae5547fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:10 user nova-compute[75244]: DEBUG os_vif [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2721fa9f-cb, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: 071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.network.neutron [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96b865f3-7452-4191-87a7-0e30cf716c41) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-93daea45-ed35-4249-8c8a-0fda6a8f2ce7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.network.neutron [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port 93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:11 user nova-compute[75244]: INFO os_vif [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=2721fa9f-cbf6-4e2b-979a-e045ae5547fb,network=Network(394006ec-3e89-47a7-8ffa-64d0d7a8cd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2721fa9f-cb')
Nov 29 23:07:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Deleting instance files /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b_del
Nov 29 23:07:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Deletion of /opt/stack/data/nova/instances/d659418e-64fb-4c3e-9569-7011295c252b_del complete
Nov 29 23:07:11 user nova-compute[75244]: INFO nova.compute.manager [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 29 23:07:11 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: d659418e-64fb-4c3e-9569-7011295c252b] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.network.neutron [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG nova.network.neutron [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0da178f7-9ebc-402c-b730-bc0de61902c1 req-8ded1b51-7e70-42e7-8a95-e4ff3ee406dd service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-vif-unplugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] No waiting events found dispatching network-vif-unplugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-vif-unplugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-071960bf-3ca4-4736-9646-8834f03c2200. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port 071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Acquiring lock "d659418e-64fb-4c3e-9569-7011295c252b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] Lock "d659418e-64fb-4c3e-9569-7011295c252b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] No waiting events found dispatching network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:12 user nova-compute[75244]: WARNING nova.compute.manager [req-c35f5f2d-3bc6-4899-9ee6-2f9122a648c8 req-0d0a5d24-111f-431a-af65-6e473206dc98 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received unexpected event network-vif-plugged-2721fa9f-cbf6-4e2b-979a-e045ae5547fb for instance with vm_state active and task_state deleting.
Nov 29 23:07:12 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:13 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Took 1.63 seconds to deallocate network for instance.
Nov 29 23:07:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: 5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:13 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Deleted allocations for instance d659418e-64fb-4c3e-9569-7011295c252b
Nov 29 23:07:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c6ba73f7-24cd-490b-b89a-d491b9541052 tempest-TestServerVolumeAttachScenarioOldVersion-151225029 tempest-TestServerVolumeAttachScenarioOldVersion-151225029-project-member] Lock "d659418e-64fb-4c3e-9569-7011295c252b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.078s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Successfully updated port: 56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:07:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:07:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: d659418e-64fb-4c3e-9569-7011295c252b] Received event network-vif-deleted-2721fa9f-cbf6-4e2b-979a-e045ae5547fb {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-5517399b-85e1-48f3-928d-049ee6f75695. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [{"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance network_info: |[{"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:07:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port 5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updated VIF entry in instance network info cache for port 5517399b-85e1-48f3-928d-049ee6f75695. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [{"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-56fd4b0b-94f0-4faa-a782-d75dffc72960. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port 56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updated VIF entry in instance network info cache for port 56fd4b0b-94f0-4faa-a782-d75dffc72960. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [{"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3693921e-2667-4e2e-a878-28a3bac764a4 req-e6eab873-0206-4b24-93e7-6877caf83c71 service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing instance network info cache due to event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:18 user nova-compute[75244]: DEBUG nova.network.neutron [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updated VIF entry in instance network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:07:18 user nova-compute[75244]: DEBUG nova.network.neutron [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-75a93965-8871-4c64-9dad-412619d3115f req-2e9fa8c9-b285-4152-a30e-90d020f513f7 service nova] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:19 user nova-compute[75244]: INFO nova.compute.manager [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Detaching volume 461de32b-485a-43f2-a2d3-75801f587a03
Nov 29 23:07:19 user nova-compute[75244]: INFO nova.virt.block_device [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Attempting to driver detach volume 461de32b-485a-43f2-a2d3-75801f587a03 from mountpoint /dev/vdb
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Attempting to detach device vdb from instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:07:19 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:19 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:07:19 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:07:19 user nova-compute[75244]:   <serial>461de32b-485a-43f2-a2d3-75801f587a03</serial>
Nov 29 23:07:19 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:07:19 user nova-compute[75244]: </disk>
Nov 29 23:07:19 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:07:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully detached device vdb from instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 from the persistent domain config.
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:07:19 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:19 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:07:19 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:07:19 user nova-compute[75244]:   <serial>461de32b-485a-43f2-a2d3-75801f587a03</serial>
Nov 29 23:07:19 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:07:19 user nova-compute[75244]: </disk>
Nov 29 23:07:19 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:07:19 user nova-compute[75244]: INFO nova.virt.block_device [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Booting with volume 5913f69e-ace9-49dd-815c-816d8cc08680 at /dev/vdb
Nov 29 23:07:19 user nova-compute[75244]: DEBUG os_brick.utils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c80632-bc67-4d8a-bcb6-76e66b0f0631]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c88e68-281a-4b17-aebe-32c5768e843b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing instance network info cache due to event network-changed-c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] Acquiring lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] Acquired lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Refreshing network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f6ed2-c839-4f53-93f5-a4d4f9947b86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6638efe6-eded-43c5-a39b-a4ff94cfc5cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:07:19 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:07:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e5756-9961-4a7c-ac50-2433c8daf6fb]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG os_brick.utils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:19 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating existing volume attachment record: 1f99fff7-20ac-4abe-82c5-a298625a2abe {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:07:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updated VIF entry in instance network info cache for port c93559b4-ae7f-48b3-8bb4-a3cead7495f7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:07:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [{"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e882f878-7604-4089-9e96-489c1308a0e8 req-4c9d1b39-2d39-481c-a08f-c8dc4f50de63 service nova] Releasing lock "refresh_cache-f54c0598-0bc1-40c2-ae18-db0bc62f3039" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:30 user nova-compute[75244]: INFO nova.compute.manager [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Detaching volume 57d70862-7a8b-47b5-8aaf-9af1df5a579e
Nov 29 23:07:30 user nova-compute[75244]: INFO nova.virt.block_device [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Attempting to driver detach volume 57d70862-7a8b-47b5-8aaf-9af1df5a579e from mountpoint /dev/vdc
Nov 29 23:07:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Attempting to detach device vdc from instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:07:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:07:30 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:30 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:07:30 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:07:30 user nova-compute[75244]:   <serial>57d70862-7a8b-47b5-8aaf-9af1df5a579e</serial>
Nov 29 23:07:30 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:07:30 user nova-compute[75244]: </disk>
Nov 29 23:07:30 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:07:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:30 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully detached device vdc from instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 from the persistent domain config.
Nov 29 23:07:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:07:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:07:30 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:30 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:07:30 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:07:30 user nova-compute[75244]:   <serial>57d70862-7a8b-47b5-8aaf-9af1df5a579e</serial>
Nov 29 23:07:30 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:07:30 user nova-compute[75244]: </disk>
Nov 29 23:07:30 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:07:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:07:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Skipping network cache update for instance because it is Building. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:07:33 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 0e2feb16-677d-4713-8646-dbed4fe33e59 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updating instance_info_cache with network_info: [{"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-0e2feb16-677d-4713-8646-dbed4fe33e59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:07:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7465MB free_disk=25.336414337158203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f2b866e9-d721-494e-b4ce-9605047d87de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b8ceea92-f765-46a7-8851-3bdacb386732 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f285c6d6-ccb5-419a-94df-0d608f08c33c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 49d04f90-df1c-4cfb-84d5-8759a5871796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:07:38 user nova-compute[75244]: INFO nova.virt.block_device [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Booting with volume ab334918-77ea-40b3-b53f-88949249a609 at /dev/vdc
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG os_brick.utils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9102c50-a923-4eef-a2c1-0c818aee3188]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce47ed29-950e-4d6a-ae0c-ccc7c0cc14fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b39169-4a73-44cf-92f0-b676150f1e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c1cdb-e81f-4835-9ff4-5d02acc56f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:07:39 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8624a8af-a0e7-4acb-bc81-ce6a550dfde9]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.utils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating existing volume attachment record: 4ae80d0a-3f34-4262-941c-03321e7c8907 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:07:39 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 is timed out.
Nov 29 23:07:39 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully detached device vdb from instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 from the live domain config.
Nov 29 23:07:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyebdYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:39 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e94ff4-7b95-4579-8b2b-d1097962defd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:07:39 user nova-compute[75244]: No targets found.
Nov 29 23:07:39 user nova-compute[75244]: iSNS:
Nov 29 23:07:39 user nova-compute[75244]: No targets found.
Nov 29 23:07:39 user nova-compute[75244]: STATIC:
Nov 29 23:07:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e
Nov 29 23:07:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:07:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:07:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:07:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03
Nov 29 23:07:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:39 user nova-compute[75244]: FIRMWARE:
Nov 29 23:07:39 user nova-compute[75244]: No targets found.
Nov 29 23:07:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:07:39 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:07:39 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea6fa24-5890-4289-8d19-b1fe5f087f2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c45d4-2fcb-44d5-87f2-11281dfe5915]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:39 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804202d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[479488cc-e4bc-42f6-8c6e-1daa278de7bc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[41578cbc-db6e-4674-b6ea-e0a991daaa99]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a6ac8b-b970-49cf-a011-e583cd6ff821]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8adf4a2-23c0-4e15-9220-83ffdd92067d]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3b0ac-0ab1-45bb-8da0-3643e9e296cf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee24deab-80ac-483c-8155-ce37ff83e9ca]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260]
Nov 29 23:07:40 user nova-compute[75244]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03, portal: 172.16.0.220,3260] successful.
Nov 29 23:07:40 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:461de32b-485a-43f2-a2d3-75801f587a03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5219bc2b-4ac1-43b3-b133-37294b46ebc9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== disconnect_volume: return (337ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:40 user nova-compute[75244]: INFO nova.compute.manager [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Detaching volume 5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:07:40 user nova-compute[75244]: INFO nova.virt.block_device [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Attempting to driver detach volume 5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d from mountpoint /dev/vdb
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Attempting to detach device vdb from instance 019c268b-dc0f-4e68-95e2-f26f5c24463b from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:07:40 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:40 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:07:40 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:07:40 user nova-compute[75244]:   <serial>5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d</serial>
Nov 29 23:07:40 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:07:40 user nova-compute[75244]: </disk>
Nov 29 23:07:40 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:07:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully detached device vdb from instance 019c268b-dc0f-4e68-95e2-f26f5c24463b from the persistent domain config.
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 019c268b-dc0f-4e68-95e2-f26f5c24463b from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:07:40 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:40 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:07:40 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:07:40 user nova-compute[75244]:   <serial>5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d</serial>
Nov 29 23:07:40 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:07:40 user nova-compute[75244]: </disk>
Nov 29 23:07:40 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'flavor' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e06c522-08fc-4676-807f-4ced4a42e06d tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.875s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:07:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 is timed out.
Nov 29 23:07:50 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully detached device vdc from instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0 from the live domain config.
Nov 29 23:07:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PODwyecQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:50 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02ad5a-91b0-4b16-8012-8efdd1642f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:07:50 user nova-compute[75244]: No targets found.
Nov 29 23:07:50 user nova-compute[75244]: iSNS:
Nov 29 23:07:50 user nova-compute[75244]: No targets found.
Nov 29 23:07:50 user nova-compute[75244]: STATIC:
Nov 29 23:07:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e
Nov 29 23:07:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:07:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:07:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:50 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:07:50 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:50 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:50 user nova-compute[75244]: FIRMWARE:
Nov 29 23:07:50 user nova-compute[75244]: No targets found.
Nov 29 23:07:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:07:50 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:07:50 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0741aa-988d-4756-9f2a-302172f649c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46322bb-d02e-4d76-83a1-470063a6bbb9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:50 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:07:50 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:50 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:50 user nova-compute[75244]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e (non-flash)
Nov 29 23:07:50 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:50 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8042103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[433bd3db-af8a-442e-b1f8-999a7176b97f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22c720-643a-41cf-a581-c6c07681e575]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de66316b-c157-4f11-a8ab-9a075e77583b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6f416-712f-46fa-97ac-dace8778e843]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5bf763-6146-405b-84cb-e8450ec58886]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[659c88a8-3012-4d8c-a2c2-0f1954d09877]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260]
Nov 29 23:07:51 user nova-compute[75244]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e, portal: 172.16.0.220,3260] successful.
Nov 29 23:07:51 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d70862-7a8b-47b5-8aaf-9af1df5a579e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce6e37-6b52-4aae-84d9-88a873fa5b6f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] <== disconnect_volume: return (355ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'flavor' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b0d5c1e9-3e8e-48b5-9e71-0300a306916e tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:07:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Creating image(s)
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Ensure instance console log exists: /opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Start _get_guest_xml network_info=[{"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEMdJeFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89', 'attached_at': '', 'detached_at': '', 'volume_id': '5f93a5a6-4148-4752-989d-7d4909a3c7f0', 'serial': '5f93a5a6-4148-4752-989d-7d4909a3c7f0'}, 'attachment_id': '619f8b48-cd59-4e3d-a5e0-a426097b7d35', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZDfQyXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89', 'attached_at': '', 'detached_at': '', 'volume_id': '5913f69e-ace9-49dd-815c-816d8cc08680', 'serial': '5913f69e-ace9-49dd-815c-816d8cc08680'}, 'attachment_id': '1f99fff7-20ac-4abe-82c5-a298625a2abe', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvYjVRHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab334918-77ea-40b3-b53f-88949249a609', 'serial': 'ab334918-77ea-40b3-b53f-88949249a609'}, 'attachment_id': '4ae80d0a-3f34-4262-941c-03321e7c8907', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:07:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:07:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEMdJeFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:53 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd91bec-7839-48ef-bcca-e254dd626e59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:07:53 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[047497cc-f8c4-4e41-92ad-0f3b7e5c83c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0] added
Nov 29 23:07:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79cbb66-07c2-4f67-aa74-9c97bc8eede3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d363713-0844-4560-8832-be724a9a102a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEMdJeFC {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEMdJeFC" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3913c9-6a18-4fda-8012-bfd1894a4887]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEMdJeFC'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b9197-32ed-474c-9708-e8cde1fc32d4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c330d1-6c9c-4b30-8761-f53caeb0bdcb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4625b1-2e9d-40c1-99d0-d786b396188d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260]
Nov 29 23:07:53 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260] successful.
Nov 29 23:07:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[286f5385-43d7-4beb-9b1d-37f64185c4f7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b20553a-f817-4918-aef4-1d54e6224df9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:53 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa341d-4418-4d7c-a539-29cc491bbcf5]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:07:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEMdJeFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23765383633313138', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765383633313138', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZDfQyXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:54 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:54 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:54 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e4a66-04aa-4d77-86c6-a5cd1e6ac18a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:07:54 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67cc3ec-90d3-4d71-9c1a-e03fde9fcc98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680] added
Nov 29 23:07:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19755932-fad8-426a-abed-7fdc42c4862a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473422f-938e-4568-970f-ade87316c6f5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZDfQyXL {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZDfQyXL" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94752e-6838-43d1-8340-5dc25d05faa9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TZDfQyXL'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2924b69f-d31b-41bf-85d0-4104fd624043]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-changed-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Refreshing instance network info cache due to event network-changed-475156ec-7744-46e6-95f8-9703c9f6f777. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] Acquiring lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] Acquired lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Refreshing network info cache for port 475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c758e-21f7-413a-bf1a-2a80ba8a52d1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[717232bb-2f92-4d73-b38f-5efc7b4ca407]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260]
Nov 29 23:07:54 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260] successful.
Nov 29 23:07:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2dba9-63ba-4b76-8b4c-ef09e34d12a6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb194aa-9cce-43a3-a988-aa938c517c89]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:07:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f670e54a-3469-4d16-a999-1a0702179352]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZDfQyXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG nova.network.neutron [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updated VIF entry in instance network info cache for port 475156ec-7744-46e6-95f8-9703c9f6f777. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG nova.network.neutron [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating instance_info_cache with network_info: [{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:07:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6fc13865-9f10-46e3-bb38-11f2a28c6e66 req-862ca8be-d2fb-4e62-b83b-d0643f578832 service nova] Releasing lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26639393561336433', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639393561336433', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvYjVRHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:56 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a41ffb8-c721-484d-85b6-2089887c752f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:07:56 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be211d3-6bc8-4c09-97be-9f6952899492]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609] added
Nov 29 23:07:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[48448aea-f214-452f-80b3-f2569009678c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b46f8-e9e7-40b9-9a15-de1054d4f4ce]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvYjVRHP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvYjVRHP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b2518-a585-4b00-b24f-85f2af963183]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvYjVRHP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba645a84-d32a-41b3-916d-781f51adc691]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84a1ff-f03f-40de-a322-fef57278701f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f897df0-61ab-4ff0-a419-b2445448b8c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260]
Nov 29 23:07:56 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260] successful.
Nov 29 23:07:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f76c19-b4b9-47c4-a9ea-0533cb05be81]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0106a914-19a7-4ed1-adf2-fa8558f234eb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:07:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f35a87d-cc20-465c-aa1f-f92bae1336f5]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:07:56 user nova-compute[75244]: INFO nova.compute.manager [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Rebuilding instance
Nov 29 23:07:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-e7b7d4e3-98f0-4e81-9ee7-96cf94696a72 req-4fd61bd3-88c9-4fed-9a38-3a0f3be478ac service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-unplugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e7b7d4e3-98f0-4e81-9ee7-96cf94696a72 req-4fd61bd3-88c9-4fed-9a38-3a0f3be478ac service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e7b7d4e3-98f0-4e81-9ee7-96cf94696a72 req-4fd61bd3-88c9-4fed-9a38-3a0f3be478ac service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e7b7d4e3-98f0-4e81-9ee7-96cf94696a72 req-4fd61bd3-88c9-4fed-9a38-3a0f3be478ac service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-e7b7d4e3-98f0-4e81-9ee7-96cf94696a72 req-4fd61bd3-88c9-4fed-9a38-3a0f3be478ac service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-unplugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:57 user nova-compute[75244]: WARNING nova.compute.manager [req-e7b7d4e3-98f0-4e81-9ee7-96cf94696a72 req-4fd61bd3-88c9-4fed-9a38-3a0f3be478ac service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-unplugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state active and task_state rebuilding.
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvYjVRHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26231613830303731', 'path': '/dev/sdg'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231613830303731', 'path': '/dev/sdg'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lazy-loading 'pci_devices' on Instance uuid 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:07:57 user nova-compute[75244]:   <uuid>36433b7b-48ac-4d62-8c90-5c7bf8e70c89</uuid>
Nov 29 23:07:57 user nova-compute[75244]:   <name>instance-00000012</name>
Nov 29 23:07:57 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:07:57 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:07:57 user nova-compute[75244]:   <metadata>
Nov 29 23:07:57 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:07:57 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:07:57 user nova-compute[75244]:       <nova:name>tempest-device-tagging-server-1860282848</nova:name>
Nov 29 23:07:57 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:07:53</nova:creationTime>
Nov 29 23:07:57 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:07:57 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:07:57 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:07:57 user nova-compute[75244]:       <nova:owner>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:user uuid="eba8741256384b64a7f789c9601a9ef8">tempest-TaggedBootDevicesTest-138562233-project-member</nova:user>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:project uuid="b1036182cd9b4ce98f5c43b312c4ebe8">tempest-TaggedBootDevicesTest-138562233</nova:project>
Nov 29 23:07:57 user nova-compute[75244]:       </nova:owner>
Nov 29 23:07:57 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:07:57 user nova-compute[75244]:       <nova:ports>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="d6b7adb2-824f-4381-82ad-8000e7bcc0d6">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="588b2724-774c-4898-888a-af320dd4d8a1">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="49fca043-bdd4-4f8f-9f3d-726404756b6d">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="93daea45-ed35-4249-8c8a-0fda6a8f2ce7">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="071960bf-3ca4-4736-9646-8834f03c2200">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="5517399b-85e1-48f3-928d-049ee6f75695">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:         <nova:port uuid="56fd4b0b-94f0-4faa-a782-d75dffc72960">
Nov 29 23:07:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 23:07:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:07:57 user nova-compute[75244]:       </nova:ports>
Nov 29 23:07:57 user nova-compute[75244]:     </nova:instance>
Nov 29 23:07:57 user nova-compute[75244]:   </metadata>
Nov 29 23:07:57 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:07:57 user nova-compute[75244]:     <system>
Nov 29 23:07:57 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:07:57 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:07:57 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:07:57 user nova-compute[75244]:       <entry name="serial">36433b7b-48ac-4d62-8c90-5c7bf8e70c89</entry>
Nov 29 23:07:57 user nova-compute[75244]:       <entry name="uuid">36433b7b-48ac-4d62-8c90-5c7bf8e70c89</entry>
Nov 29 23:07:57 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:07:57 user nova-compute[75244]:     </system>
Nov 29 23:07:57 user nova-compute[75244]:   </sysinfo>
Nov 29 23:07:57 user nova-compute[75244]:   <os>
Nov 29 23:07:57 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:07:57 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:07:57 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:07:57 user nova-compute[75244]:   </os>
Nov 29 23:07:57 user nova-compute[75244]:   <features>
Nov 29 23:07:57 user nova-compute[75244]:     <acpi/>
Nov 29 23:07:57 user nova-compute[75244]:     <apic/>
Nov 29 23:07:57 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:07:57 user nova-compute[75244]:   </features>
Nov 29 23:07:57 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:07:57 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:07:57 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:07:57 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:07:57 user nova-compute[75244]:   </clock>
Nov 29 23:07:57 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:07:57 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:07:57 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:07:57 user nova-compute[75244]:   </cpu>
Nov 29 23:07:57 user nova-compute[75244]:   <devices>
Nov 29 23:07:57 user nova-compute[75244]:     <disk type="file" device="cdrom">
Nov 29 23:07:57 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 23:07:57 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89/disk.config"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="hda" bus="ide"/>
Nov 29 23:07:57 user nova-compute[75244]:     </disk>
Nov 29 23:07:57 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:07:57 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:57 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <serial>5f93a5a6-4148-4752-989d-7d4909a3c7f0</serial>
Nov 29 23:07:57 user nova-compute[75244]:     </disk>
Nov 29 23:07:57 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:07:57 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:57 user nova-compute[75244]:       <source dev="/dev/sdd"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <serial>5913f69e-ace9-49dd-815c-816d8cc08680</serial>
Nov 29 23:07:57 user nova-compute[75244]:     </disk>
Nov 29 23:07:57 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:07:57 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:07:57 user nova-compute[75244]:       <source dev="/dev/sdg"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="vdc" bus="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <serial>ab334918-77ea-40b3-b53f-88949249a609</serial>
Nov 29 23:07:57 user nova-compute[75244]:     </disk>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:3d:40:46"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tapd6b7adb2-82"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:97:30:24"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tap588b2724-77"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:a9:76:4b"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tap49fca043-bd"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:1d:71:cb"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tap93daea45-ed"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:6a:dd:69"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tap071960bf-3c"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:d8:bf:bd"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tap5517399b-85"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:07:57 user nova-compute[75244]:       <mac address="fa:16:3e:91:b8:79"/>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:07:57 user nova-compute[75244]:       <target dev="tap56fd4b0b-94"/>
Nov 29 23:07:57 user nova-compute[75244]:     </interface>
Nov 29 23:07:57 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:07:57 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89/console.log" append="off"/>
Nov 29 23:07:57 user nova-compute[75244]:     </serial>
Nov 29 23:07:57 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:07:57 user nova-compute[75244]:     <video>
Nov 29 23:07:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:07:57 user nova-compute[75244]:     </video>
Nov 29 23:07:57 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:07:57 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:07:57 user nova-compute[75244]:     </rng>
Nov 29 23:07:57 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:07:57 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:07:57 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:07:57 user nova-compute[75244]:     </memballoon>
Nov 29 23:07:57 user nova-compute[75244]:   </devices>
Nov 29 23:07:57 user nova-compute[75244]: </domain>
Nov 29 23:07:57 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b11a796d-cfd2-5aab-ae7d-8092632c7fc5', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6b7adb2-82, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6b7adb2-82, col_values=(('qos', UUID('021c4605-d402-46a2-9948-e41a2fd939f1')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6b7adb2-82, col_values=(('external_ids', {'iface-id': 'd6b7adb2-824f-4381-82ad-8000e7bcc0d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:40:46', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82')
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a023239f-75d8-5381-9399-f249ffab0afb', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance destroyed successfully.
Nov 29 23:07:57 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance destroyed successfully.
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1985742742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1038057022',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5E3Tsq5bbF9bdpJnsYkIAIienF8hmPQXzNUhNp2gKZCBRd+lp43mKtu7gxh++Wp6Li9ezdn0RmsDzgcwlFYEzAWJqfRjy5edd4uf7DcDG3fiiq9ZHensfgVJTB4AOg==',key_name='tempest-keypair-637915247',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c65023bfd4a461fbbc63d2c08d930a8',ramdisk_id='',reservation_id='r-br52rfyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439423886',owner_user_name='tempest-ServerActionsV293TestJSON-439423886-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd93ba0909bd44dfae59be5b157cb0cf',uuid=f285c6d6-ccb5-419a-94df-0d608f08c33c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converting VIF {"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap475156ec-77, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap588b2724-77, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap588b2724-77, col_values=(('qos', UUID('86903bfe-92d3-4bd1-9c13-8c0adb2ec91d')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap588b2724-77, col_values=(('external_ids', {'iface-id': '588b2724-774c-4898-888a-af320dd4d8a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:30:24', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77')
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e8919f6-3353-4bf0-adc4-bec0f5f71b98) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5f37bfb-cf78-5177-8a95-668e2703fc98', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: INFO os_vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77')
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:57 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49fca043-bd, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49fca043-bd, col_values=(('qos', UUID('2ff01f82-5a44-4b63-a029-ee7f805ea12d')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49fca043-bd, col_values=(('external_ids', {'iface-id': '49fca043-bdd4-4f8f-9f3d-726404756b6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:76:4b', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ea655-d544-45dc-a046-9586c536adbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:07:57 user nova-compute[75244]: No targets found.
Nov 29 23:07:57 user nova-compute[75244]: iSNS:
Nov 29 23:07:57 user nova-compute[75244]: No targets found.
Nov 29 23:07:57 user nova-compute[75244]: STATIC:
Nov 29 23:07:57 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609
Nov 29 23:07:57 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:57 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:57 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:07:57 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:57 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:57 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:07:57 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:57 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:57 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:07:57 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:57 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:57 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680
Nov 29 23:07:57 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:57 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:57 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0
Nov 29 23:07:57 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:57 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:57 user nova-compute[75244]: FIRMWARE:
Nov 29 23:07:57 user nova-compute[75244]: No targets found.
Nov 29 23:07:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:07:57 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:07:57 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:07:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7024341b-87f4-48ab-87d3-fc40e7e0eda1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd')
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a0bd7e9-1c19-5ae6-a248-3cdb2c55c806', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b17a2-ce75-4e92-bb32-849902fe238f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8042ef5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8'): ({'sdf'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Removing single pathed devices sdf {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93daea45-ed, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93daea45-ed, col_values=(('qos', UUID('6aee0f85-3361-4df4-b996-230a127357bd')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93daea45-ed, col_values=(('external_ids', {'iface-id': '93daea45-ed35-4249-8c8a-0fda6a8f2ce7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:71:cb', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97b13f-8251-4423-b790-f4468ab2dce0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d70d8c4-d251-48ef-84b2-eafc47b8039a]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Flushing IO for device /dev/sdf {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed')
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d5592-0a95-4f61-adf9-7ac4ff855bd4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '866acd7b-b6e6-5037-81c3-0195615dbb31', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap071960bf-3c, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap071960bf-3c, col_values=(('qos', UUID('b300897b-1511-4092-833f-dd5ff4b7e9f7')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap071960bf-3c, col_values=(('external_ids', {'iface-id': '071960bf-3ca4-4736-9646-8834f03c2200', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:dd:69', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a843c61-c6eb-41fc-a8a6-d97dbbb9c577]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f7a88d-0e69-47c9-9bcb-e4c26e7e1c2b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c')
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd956a7f2-addf-5a2b-867d-e77c2f7611b2', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baa646-618a-4696-845b-e4552645137e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]
Nov 29 23:07:58 user nova-compute[75244]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.
Nov 29 23:07:58 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5517399b-85, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5517399b-85, col_values=(('qos', UUID('126c04f0-fc0f-4c36-8aff-02391e3fbd10')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5517399b-85, col_values=(('external_ids', {'iface-id': '5517399b-85e1-48f3-928d-049ee6f75695', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:bf:bd', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[052dadb0-c67b-4f1a-9aaf-f72b8ab8c899]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== disconnect_volume: return (326ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:07:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Deleting instance files /opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c_del
Nov 29 23:07:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Deletion of /opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c_del complete
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85')
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc863a55-83a1-5f0d-8239-4bcab9362d0f', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56fd4b0b-94, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56fd4b0b-94, col_values=(('qos', UUID('b3465611-90d5-499d-8af8-1ceb2e499dcc')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56fd4b0b-94, col_values=(('external_ids', {'iface-id': '56fd4b0b-94f0-4faa-a782-d75dffc72960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:b8:79', 'vm-uuid': '36433b7b-48ac-4d62-8c90-5c7bf8e70c89'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:07:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f285c6d6-ccb5-419a-94df-0d608f08c33c could not be found.
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:07:58 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:07:58 user nova-compute[75244]: INFO os_vif [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94')
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da5d5e-8fe8-4d14-a26d-0db2a55eae49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:07:58 user nova-compute[75244]: No targets found.
Nov 29 23:07:58 user nova-compute[75244]: iSNS:
Nov 29 23:07:58 user nova-compute[75244]: No targets found.
Nov 29 23:07:58 user nova-compute[75244]: STATIC:
Nov 29 23:07:58 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609
Nov 29 23:07:58 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:58 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:58 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:07:58 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:58 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:58 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:07:58 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:58 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:58 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680
Nov 29 23:07:58 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:58 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:58 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0
Nov 29 23:07:58 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:07:58 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:07:58 user nova-compute[75244]: FIRMWARE:
Nov 29 23:07:58 user nova-compute[75244]: No targets found.
Nov 29 23:07:58 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:07:58 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:07:58 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ae107-d3e8-4899-a61a-ab6fb7a9dd3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] No BDM found with device name hda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] No VIF found with MAC fa:16:3e:3d:40:46, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] No VIF found with MAC fa:16:3e:6a:dd:69, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:07:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Using config drive
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b95f689-fc8a-4f89-81a1-f64ed6cbc34a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:07:58 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c477ac0>, {}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Disconnecting from: [] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== disconnect_volume: return (95ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:07:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Creating config drive at /opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89/disk.config
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpakp9udh3 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:07:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpakp9udh3" returned: 0 in 0.056s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-5679fd9f-b3df-4f96-87b5-37e772c7d2b1 req-33dc0f9d-bca4-4829-874e-13a3ed390d46 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5679fd9f-b3df-4f96-87b5-37e772c7d2b1 req-33dc0f9d-bca4-4829-874e-13a3ed390d46 service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5679fd9f-b3df-4f96-87b5-37e772c7d2b1 req-33dc0f9d-bca4-4829-874e-13a3ed390d46 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5679fd9f-b3df-4f96-87b5-37e772c7d2b1 req-33dc0f9d-bca4-4829-874e-13a3ed390d46 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-5679fd9f-b3df-4f96-87b5-37e772c7d2b1 req-33dc0f9d-bca4-4829-874e-13a3ed390d46 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:07:59 user nova-compute[75244]: WARNING nova.compute.manager [req-5679fd9f-b3df-4f96-87b5-37e772c7d2b1 req-33dc0f9d-bca4-4829-874e-13a3ed390d46 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state active and task_state rebuilding.
Nov 29 23:07:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Preparing to wait for external event volume-reimaged-1c294d3d-4c05-473a-a2dc-95a642351df8 {{(pid=75244) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:07:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:00 user nova-compute[75244]: INFO nova.compute.manager [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Terminating instance
Nov 29 23:08:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 019c268b-dc0f-4e68-95e2-f26f5c24463b is timed out.
Nov 29 23:08:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully detached device vdb from instance 019c268b-dc0f-4e68-95e2-f26f5c24463b from the live domain config.
Nov 29 23:08:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmGolsAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:08:00 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b2aa5a-3f75-4572-864d-11e34865c604]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:08:00 user nova-compute[75244]: No targets found.
Nov 29 23:08:00 user nova-compute[75244]: iSNS:
Nov 29 23:08:00 user nova-compute[75244]: No targets found.
Nov 29 23:08:00 user nova-compute[75244]: STATIC:
Nov 29 23:08:00 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609
Nov 29 23:08:00 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:08:00 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:08:00 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d
Nov 29 23:08:00 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:08:00 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:08:00 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:08:00 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:08:00 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:08:00 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680
Nov 29 23:08:00 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:08:00 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:08:00 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0
Nov 29 23:08:00 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:08:00 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:08:00 user nova-compute[75244]: FIRMWARE:
Nov 29 23:08:00 user nova-compute[75244]: No targets found.
Nov 29 23:08:00 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:08:00 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:08:00 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a1388a-cde0-4c80-8e2a-3cebab037b79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0547e1f9-4920-4ecd-88d9-9cb5b11aad06]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:08:00 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:08:00 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:08:00 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8042ecaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c512cf-b599-4282-82cb-a48644c4585f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-0023d246-e6f9-4fe2-9d78-eab07839b021 req-2e110f01-abd5-4a4d-a33a-0ac092b61755 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-vif-unplugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0023d246-e6f9-4fe2-9d78-eab07839b021 req-2e110f01-abd5-4a4d-a33a-0ac092b61755 service nova] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0023d246-e6f9-4fe2-9d78-eab07839b021 req-2e110f01-abd5-4a4d-a33a-0ac092b61755 service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0023d246-e6f9-4fe2-9d78-eab07839b021 req-2e110f01-abd5-4a4d-a33a-0ac092b61755 service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-0023d246-e6f9-4fe2-9d78-eab07839b021 req-2e110f01-abd5-4a4d-a33a-0ac092b61755 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] No waiting events found dispatching network-vif-unplugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-0023d246-e6f9-4fe2-9d78-eab07839b021 req-2e110f01-abd5-4a4d-a33a-0ac092b61755 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-vif-unplugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5190598c-5f37-4fc8-b72d-7e06dd4df309]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[42538a23-9194-4ba3-9dbe-aca97c5f0ab6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1bffe-739a-4508-805e-69fdb3f03ddf]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fbc09-85e9-46b7-973c-45d7d0157aa6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f12b6a-8c16-4995-9c0e-347842d68bd2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260]
Nov 29 23:08:01 user nova-compute[75244]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d, portal: 172.16.0.220,3260] successful.
Nov 29 23:08:01 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:01 user nova-compute[75244]: WARNING nova.compute.manager [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 for instance with vm_state building and task_state spawning.
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:01 user nova-compute[75244]: WARNING nova.compute.manager [req-df8c6dbb-1d65-439c-beab-687de2a4d555 req-cb77317b-d123-480b-9ba7-3e213fcb0042 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 for instance with vm_state building and task_state spawning.
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed64f4d-2979-4b8d-9bb4-29e9bfa6176d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e52098e-11e0-49c3-b77d-cd1e362ed9e6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== disconnect_volume: return (458ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-cdf24563-911a-49ec-904b-6f7679c45754 req-ef5d17dc-c919-47c3-97f0-fe5420663344 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cdf24563-911a-49ec-904b-6f7679c45754 req-ef5d17dc-c919-47c3-97f0-fe5420663344 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cdf24563-911a-49ec-904b-6f7679c45754 req-ef5d17dc-c919-47c3-97f0-fe5420663344 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cdf24563-911a-49ec-904b-6f7679c45754 req-ef5d17dc-c919-47c3-97f0-fe5420663344 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-cdf24563-911a-49ec-904b-6f7679c45754 req-ef5d17dc-c919-47c3-97f0-fe5420663344 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:01 user nova-compute[75244]: WARNING nova.compute.manager [req-cdf24563-911a-49ec-904b-6f7679c45754 req-ef5d17dc-c919-47c3-97f0-fe5420663344 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 for instance with vm_state building and task_state spawning.
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Instance destroyed successfully.
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.objects.instance [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lazy-loading 'resources' on Instance uuid f2b866e9-d721-494e-b4ce-9605047d87de {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1955421205',display_name='tempest-VolumesAdminNegativeTest-server-1955421205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1955421205',id=5,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXxcUbuV0kuETEvl8eq4Z1VPni7CXMIIfq2d+ZtD7VTaV9fZnGqIL5lfpduVREEqLlUSt8VstWWBfS9cP0OKcDUCarV8u3h8m2V1VrXg1F9CYYzRk+BJSkeZgZkbcukfg==',key_name='tempest-keypair-906342697',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa2f1cf1914faa9c73096e1cb1b8e9',ramdisk_id='',reservation_id='r-j233y8bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-778262822',owner_user_name='tempest-VolumesAdminNegativeTest-778262822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df0d594179f64f79b1b66cbeea8bac59',uuid=f2b866e9-d721-494e-b4ce-9605047d87de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converting VIF {"id": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "address": "fa:16:3e:b7:32:40", "network": {"id": "8154e2ca-145f-454f-8118-f24a67b3fdbc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-840474720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa2f1cf1914faa9c73096e1cb1b8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c393a82-e3", "ovs_interfaceid": "9c393a82-e3f5-49a4-87d6-97980abb79e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG os_vif [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c393a82-e3, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=117e734d-1ef8-4bce-a9c1-87964d47f70b) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:01 user nova-compute[75244]: INFO os_vif [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:32:40,bridge_name='br-int',has_traffic_filtering=True,id=9c393a82-e3f5-49a4-87d6-97980abb79e9,network=Network(8154e2ca-145f-454f-8118-f24a67b3fdbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c393a82-e3')
Nov 29 23:08:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Deleting instance files /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de_del
Nov 29 23:08:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Deletion of /opt/stack/data/nova/instances/f2b866e9-d721-494e-b4ce-9605047d87de_del complete
Nov 29 23:08:02 user nova-compute[75244]: INFO nova.compute.manager [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Took 1.61 seconds to destroy the instance on the hypervisor.
Nov 29 23:08:02 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG nova.objects.instance [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-33005247-4627-4b9c-9c88-199b9600fda6 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.123s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75244) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.objects.instance [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Acquiring lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Lock "f2b866e9-d721-494e-b4ce-9605047d87de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] No waiting events found dispatching network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received unexpected event network-vif-plugged-9c393a82-e3f5-49a4-87d6-97980abb79e9 for instance with vm_state active and task_state deleting.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d for instance with vm_state building and task_state spawning.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-1efe8be2-f969-400e-87f3-68b6b40a1ab5 req-ba29c216-3567-4924-ac2e-29eb3e1a4f6f service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d for instance with vm_state building and task_state spawning.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:03 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Took 1.28 seconds to deallocate network for instance.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 for instance with vm_state building and task_state spawning.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 for instance with vm_state building and task_state spawning.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 for instance with vm_state building and task_state spawning.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-9bd9a0af-bb70-44e0-9d23-91eae8af994a req-3f485e42-d170-47e0-98db-d39bc63c61f7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 for instance with vm_state building and task_state spawning.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-deb13af7-4bf1-4692-8a66-58f3009f2e0a req-e48383d3-d2ce-40fc-aee8-7a786a9dff97 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-deb13af7-4bf1-4692-8a66-58f3009f2e0a req-e48383d3-d2ce-40fc-aee8-7a786a9dff97 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-deb13af7-4bf1-4692-8a66-58f3009f2e0a req-e48383d3-d2ce-40fc-aee8-7a786a9dff97 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-deb13af7-4bf1-4692-8a66-58f3009f2e0a req-e48383d3-d2ce-40fc-aee8-7a786a9dff97 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-deb13af7-4bf1-4692-8a66-58f3009f2e0a req-e48383d3-d2ce-40fc-aee8-7a786a9dff97 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:03 user nova-compute[75244]: WARNING nova.compute.manager [req-deb13af7-4bf1-4692-8a66-58f3009f2e0a req-e48383d3-d2ce-40fc-aee8-7a786a9dff97 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state active and task_state powering-off.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:08:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:03 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance destroyed successfully.
Nov 29 23:08:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.647s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fae5ab70-d9bb-44da-aff0-8057df24119d tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.952s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:04 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Deleted allocations for instance f2b866e9-d721-494e-b4ce-9605047d87de
Nov 29 23:08:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88e1ec55-f74b-4bb3-a2c0-4e8ba7c104cf tempest-VolumesAdminNegativeTest-778262822 tempest-VolumesAdminNegativeTest-778262822-project-member] Lock "f2b866e9-d721-494e-b4ce-9605047d87de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.801s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:05 user nova-compute[75244]: WARNING nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 for instance with vm_state building and task_state spawning.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: f2b866e9-d721-494e-b4ce-9605047d87de] Received event network-vif-deleted-9c393a82-e3f5-49a4-87d6-97980abb79e9 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:05 user nova-compute[75244]: WARNING nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 for instance with vm_state building and task_state spawning.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:05 user nova-compute[75244]: WARNING nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 for instance with vm_state building and task_state spawning.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:05 user nova-compute[75244]: WARNING nova.compute.manager [req-cc3bed92-c6cf-4f06-8dd5-cfc936ef480f req-cc918361-9e64-4214-b15c-3e494aeee714 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 for instance with vm_state building and task_state spawning.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-2ec11884-9879-4a3d-acfb-80febec04861 req-af5bbd43-8684-4436-93e9-29b2ff3b47c8 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2ec11884-9879-4a3d-acfb-80febec04861 req-af5bbd43-8684-4436-93e9-29b2ff3b47c8 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2ec11884-9879-4a3d-acfb-80febec04861 req-af5bbd43-8684-4436-93e9-29b2ff3b47c8 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2ec11884-9879-4a3d-acfb-80febec04861 req-af5bbd43-8684-4436-93e9-29b2ff3b47c8 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-2ec11884-9879-4a3d-acfb-80febec04861 req-af5bbd43-8684-4436-93e9-29b2ff3b47c8 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:05 user nova-compute[75244]: WARNING nova.compute.manager [req-2ec11884-9879-4a3d-acfb-80febec04861 req-af5bbd43-8684-4436-93e9-29b2ff3b47c8 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 for instance with vm_state building and task_state spawning.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:08:05 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance spawned successfully.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-6a7d0b77-45c6-42d3-9a9d-d293e2017612 req-2abf6633-df22-470b-9525-4f6e5e6c5b0f service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6a7d0b77-45c6-42d3-9a9d-d293e2017612 req-2abf6633-df22-470b-9525-4f6e5e6c5b0f service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6a7d0b77-45c6-42d3-9a9d-d293e2017612 req-2abf6633-df22-470b-9525-4f6e5e6c5b0f service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6a7d0b77-45c6-42d3-9a9d-d293e2017612 req-2abf6633-df22-470b-9525-4f6e5e6c5b0f service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-6a7d0b77-45c6-42d3-9a9d-d293e2017612 req-2abf6633-df22-470b-9525-4f6e5e6c5b0f service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:05 user nova-compute[75244]: WARNING nova.compute.manager [req-6a7d0b77-45c6-42d3-9a9d-d293e2017612 req-2abf6633-df22-470b-9525-4f6e5e6c5b0f service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state stopped and task_state None.
Nov 29 23:08:05 user nova-compute[75244]: INFO nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Took 12.48 seconds to spawn the instance on the hypervisor.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:08:05 user nova-compute[75244]: INFO nova.compute.manager [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Took 66.75 seconds to build instance.
Nov 29 23:08:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f672140f-0eb0-4add-a4ab-d3a9eb7d7d31 tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.858s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:13 user nova-compute[75244]: WARNING nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 0e2feb16-677d-4713-8646-dbed4fe33e59 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 49d04f90-df1c-4cfb-84d5-8759a5871796 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid f285c6d6-ccb5-419a-94df-0d608f08c33c {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:13 user nova-compute[75244]: INFO nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] During sync_power_state the instance has a pending task (rebuilding). Skip.
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:15 user nova-compute[75244]: INFO nova.compute.manager [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Terminating instance
Nov 29 23:08:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c5f4295-2af0-4971-8ef3-f7ca92753aaa req-fb0e8431-1a9e-474e-965d-00bd8ad47461 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-unplugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c5f4295-2af0-4971-8ef3-f7ca92753aaa req-fb0e8431-1a9e-474e-965d-00bd8ad47461 service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c5f4295-2af0-4971-8ef3-f7ca92753aaa req-fb0e8431-1a9e-474e-965d-00bd8ad47461 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c5f4295-2af0-4971-8ef3-f7ca92753aaa req-fb0e8431-1a9e-474e-965d-00bd8ad47461 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c5f4295-2af0-4971-8ef3-f7ca92753aaa req-fb0e8431-1a9e-474e-965d-00bd8ad47461 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-unplugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c5f4295-2af0-4971-8ef3-f7ca92753aaa req-fb0e8431-1a9e-474e-965d-00bd8ad47461 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-unplugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:08:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Instance destroyed successfully.
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'resources' on Instance uuid f54c0598-0bc1-40c2-ae18-db0bc62f3039 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-396357613',display_name='tempest-TestMinimumBasicScenario-server-396357613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-396357613',id=11,image_ref='8535e5de-ca54-45f0-8b70-966754936146',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLScX4pqdrRr1ln97nLX+ALZdsjG8lNthiDFSqMku/DFwNFXN8t5ry3Zzu087GXOadHq194avwX07szSnPVyAiIQ/72vKRThTMo1Hwn9OSVqr5I+IPcKXokLXWn8ra0klA==',key_name='tempest-TestMinimumBasicScenario-1615951852',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-br2k38jo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8535e5de-ca54-45f0-8b70-966754936146',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:05:33Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=f54c0598-0bc1-40c2-ae18-db0bc62f3039,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "address": "fa:16:3e:ff:ff:ed", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93559b4-ae", "ovs_interfaceid": "c93559b4-ae7f-48b3-8bb4-a3cead7495f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG os_vif [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93559b4-ae, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bf3f536-8cfc-492c-b31c-8a0ba7a422f7) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:16 user nova-compute[75244]: INFO os_vif [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ff:ed,bridge_name='br-int',has_traffic_filtering=True,id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93559b4-ae')
Nov 29 23:08:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Deleting instance files /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039_del
Nov 29 23:08:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Deletion of /opt/stack/data/nova/instances/f54c0598-0bc1-40c2-ae18-db0bc62f3039_del complete
Nov 29 23:08:16 user nova-compute[75244]: INFO nova.compute.manager [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 23:08:16 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-e2080309-9f90-40f7-b770-cc061c95d12c req-3138d395-7950-439f-bdce-128d1d652eb9 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-deleted-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:16 user nova-compute[75244]: INFO nova.compute.manager [req-e2080309-9f90-40f7-b770-cc061c95d12c req-3138d395-7950-439f-bdce-128d1d652eb9 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Neutron deleted interface c93559b4-ae7f-48b3-8bb4-a3cead7495f7; detaching it from the instance and deleting it from the info cache
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-e2080309-9f90-40f7-b770-cc061c95d12c req-3138d395-7950-439f-bdce-128d1d652eb9 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:16 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Took 0.46 seconds to deallocate network for instance.
Nov 29 23:08:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-e2080309-9f90-40f7-b770-cc061c95d12c req-3138d395-7950-439f-bdce-128d1d652eb9 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Detach interface failed, port_id=c93559b4-ae7f-48b3-8bb4-a3cead7495f7, reason: Instance f54c0598-0bc1-40c2-ae18-db0bc62f3039 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:17 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Deleted allocations for instance f54c0598-0bc1-40c2-ae18-db0bc62f3039
Nov 29 23:08:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-1a9a-4f4a-adda-54330948edc6 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-ded2c82e-5c5a-4448-8110-2ada179ac3ca req-6a43cb1e-48e8-467c-84f3-2273793585b6 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ded2c82e-5c5a-4448-8110-2ada179ac3ca req-6a43cb1e-48e8-467c-84f3-2273793585b6 service nova] Acquiring lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ded2c82e-5c5a-4448-8110-2ada179ac3ca req-6a43cb1e-48e8-467c-84f3-2273793585b6 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ded2c82e-5c5a-4448-8110-2ada179ac3ca req-6a43cb1e-48e8-467c-84f3-2273793585b6 service nova] Lock "f54c0598-0bc1-40c2-ae18-db0bc62f3039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-ded2c82e-5c5a-4448-8110-2ada179ac3ca req-6a43cb1e-48e8-467c-84f3-2273793585b6 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] No waiting events found dispatching network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:17 user nova-compute[75244]: WARNING nova.compute.manager [req-ded2c82e-5c5a-4448-8110-2ada179ac3ca req-6a43cb1e-48e8-467c-84f3-2273793585b6 service nova] [instance: f54c0598-0bc1-40c2-ae18-db0bc62f3039] Received unexpected event network-vif-plugged-c93559b4-ae7f-48b3-8bb4-a3cead7495f7 for instance with vm_state deleted and task_state None.
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:20 user nova-compute[75244]: INFO nova.compute.manager [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Terminating instance
Nov 29 23:08:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-8631489c-0120-45d5-911a-9eaac2d8c70a req-d94bdebf-0a0f-42a6-9eca-74653098b57a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8631489c-0120-45d5-911a-9eaac2d8c70a req-d94bdebf-0a0f-42a6-9eca-74653098b57a service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8631489c-0120-45d5-911a-9eaac2d8c70a req-d94bdebf-0a0f-42a6-9eca-74653098b57a service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8631489c-0120-45d5-911a-9eaac2d8c70a req-d94bdebf-0a0f-42a6-9eca-74653098b57a service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-8631489c-0120-45d5-911a-9eaac2d8c70a req-d94bdebf-0a0f-42a6-9eca-74653098b57a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-8631489c-0120-45d5-911a-9eaac2d8c70a req-d94bdebf-0a0f-42a6-9eca-74653098b57a service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-unplugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:08:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Instance destroyed successfully.
Nov 29 23:08:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'resources' on Instance uuid 98d0cfec-ab5d-49a0-a467-f90989f51aa0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1788131671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1788131671',id=4,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNzGqm3Tm/ItTGGk6XBWULal6mqzkFsASAJf+ylMr6CFzo4MuiO5nKzCU24l3Av5hDkOEAqi530p07uUWailDkFtu7cEIMGGmEGgD7iMA9o9SjemlX3vcHOd9I10+fkzw==',key_name='tempest-keypair-1743157863',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-oyfa3jdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=98d0cfec-ab5d-49a0-a467-f90989f51aa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "8309daad-6231-443d-9aa1-9b46adbc6fea", "address": "fa:16:3e:a3:28:f0", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8309daad-62", "ovs_interfaceid": "8309daad-6231-443d-9aa1-9b46adbc6fea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG os_vif [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8309daad-62, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65c2a08c-6f08-45c7-8ce2-cc4605962c6f) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:21 user nova-compute[75244]: INFO os_vif [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:28:f0,bridge_name='br-int',has_traffic_filtering=True,id=8309daad-6231-443d-9aa1-9b46adbc6fea,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8309daad-62')
Nov 29 23:08:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Deleting instance files /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0_del
Nov 29 23:08:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Deletion of /opt/stack/data/nova/instances/98d0cfec-ab5d-49a0-a467-f90989f51aa0_del complete
Nov 29 23:08:21 user nova-compute[75244]: INFO nova.compute.manager [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 23:08:21 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:08:21 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:22 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Took 0.76 seconds to deallocate network for instance.
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:22 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Deleted allocations for instance 98d0cfec-ab5d-49a0-a467-f90989f51aa0
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ebb7c9bc-493c-44b5-8131-e46b07b494e7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] Acquiring lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] Lock "98d0cfec-ab5d-49a0-a467-f90989f51aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] No waiting events found dispatching network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:22 user nova-compute[75244]: WARNING nova.compute.manager [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received unexpected event network-vif-plugged-8309daad-6231-443d-9aa1-9b46adbc6fea for instance with vm_state deleted and task_state None.
Nov 29 23:08:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-c952f7db-4fc7-4d14-bd39-28706c49ccbc req-a4c37754-f056-40b0-aa14-453ec4a84fcd service nova] [instance: 98d0cfec-ab5d-49a0-a467-f90989f51aa0] Received event network-vif-deleted-8309daad-6231-443d-9aa1-9b46adbc6fea {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:08:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:08:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:08:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:08:34 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:08:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:08:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:08:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-6371a5de-c960-430b-90d3-f36e3d675cdd req-4fa0694a-99b9-4d36-8cd3-b10ec8eced3f service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event volume-reimaged-1c294d3d-4c05-473a-a2dc-95a642351df8 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6371a5de-c960-430b-90d3-f36e3d675cdd req-4fa0694a-99b9-4d36-8cd3-b10ec8eced3f service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6371a5de-c960-430b-90d3-f36e3d675cdd req-4fa0694a-99b9-4d36-8cd3-b10ec8eced3f service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6371a5de-c960-430b-90d3-f36e3d675cdd req-4fa0694a-99b9-4d36-8cd3-b10ec8eced3f service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-6371a5de-c960-430b-90d3-f36e3d675cdd req-4fa0694a-99b9-4d36-8cd3-b10ec8eced3f service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Processing event volume-reimaged-1c294d3d-4c05-473a-a2dc-95a642351df8 {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance event wait completed in 37 seconds for volume-reimaged {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:08:36 user nova-compute[75244]: INFO nova.virt.block_device [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Booting with volume 1c294d3d-4c05-473a-a2dc-95a642351df8 at /dev/vda
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG os_brick.utils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b126a5-9473-47bd-bc0b-1ce59fc9524c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a924221-4c7d-4c3c-be7c-5be2e28447c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eb181a-707f-4be4-b75b-3320f19d9cbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b74b43-e1d7-4542-93a8-dc95fb372fc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:08:36 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:08:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2917dd55-88bc-47e8-8ab7-cf5a8a291e79]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG os_brick.utils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:08:36 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating existing volume attachment record: eb8f19fe-3824-48fd-ab0c-3c4babbf753c {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:08:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:08:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=25.3883056640625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b8ceea92-f765-46a7-8851-3bdacb386732 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f285c6d6-ccb5-419a-94df-0d608f08c33c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 49d04f90-df1c-4cfb-84d5-8759a5871796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:08:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:08:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:08:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:08:46 user nova-compute[75244]: INFO nova.compute.manager [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] instance snapshotting
Nov 29 23:08:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Beginning live snapshot process
Nov 29 23:08:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa69yrvc9/c2ab0c6a2a8049d889d9594e66412fcd.delta 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa69yrvc9/c2ab0c6a2a8049d889d9594e66412fcd.delta 1073741824" returned: 0 in 0.062s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:47 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 23:08:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:08:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:08:48 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 23:08:48 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:08:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa69yrvc9/c2ab0c6a2a8049d889d9594e66412fcd.delta /opt/stack/data/nova/instances/snapshots/tmpa69yrvc9/c2ab0c6a2a8049d889d9594e66412fcd {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa69yrvc9/c2ab0c6a2a8049d889d9594e66412fcd.delta /opt/stack/data/nova/instances/snapshots/tmpa69yrvc9/c2ab0c6a2a8049d889d9594e66412fcd" returned: 0 in 0.983s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Snapshot extracted, beginning image upload
Nov 29 23:08:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-changed-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Refreshing instance network info cache due to event network-changed-c94c3e52-300f-4b5f-8942-08c95eab4cfe. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] Acquiring lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] Acquired lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:08:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Refreshing network info cache for port c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.compute.manager [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Terminating instance
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Updated VIF entry in instance network info cache for port c94c3e52-300f-4b5f-8942-08c95eab4cfe. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Updating instance_info_cache with network_info: [{"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb24096d-a132-4c7e-9cae-f24a6f782f14 req-2db715dd-0cc9-45e1-818d-073cd496413f service nova] Releasing lock "refresh_cache-49d04f90-df1c-4cfb-84d5-8759a5871796" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Snapshot image upload complete
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.compute.manager [None req-26ca004e-a9a6-4951-82c6-3ec2da820fcc tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Took 6.56 seconds to snapshot the instance on the hypervisor.
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-33a228a4-e687-483a-b257-0e2d216a989e req-4083effc-c8db-4737-a715-6aeed72869f4 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-vif-unplugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-33a228a4-e687-483a-b257-0e2d216a989e req-4083effc-c8db-4737-a715-6aeed72869f4 service nova] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-33a228a4-e687-483a-b257-0e2d216a989e req-4083effc-c8db-4737-a715-6aeed72869f4 service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-33a228a4-e687-483a-b257-0e2d216a989e req-4083effc-c8db-4737-a715-6aeed72869f4 service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-33a228a4-e687-483a-b257-0e2d216a989e req-4083effc-c8db-4737-a715-6aeed72869f4 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] No waiting events found dispatching network-vif-unplugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-33a228a4-e687-483a-b257-0e2d216a989e req-4083effc-c8db-4737-a715-6aeed72869f4 service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-vif-unplugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Instance destroyed successfully.
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'resources' on Instance uuid 49d04f90-df1c-4cfb-84d5-8759a5871796 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1647620043',display_name='tempest-AttachVolumeNegativeTest-server-1647620043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1647620043',id=19,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3mVp8481JgMG0yfKd75PNdZ3+iGAqBUz9KoDilGi1F/oUQCjIdjV8bbQ1UKL9O41msQwqcJ4mN+KO4Bgn/Hyc+XeevLI5ULbzqtnGiR0tUbsWRsaUgazllsUzNV6mX3g==',key_name='tempest-keypair-125789724',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-xw0m9vmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=49d04f90-df1c-4cfb-84d5-8759a5871796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "address": "fa:16:3e:b9:ea:57", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc94c3e52-30", "ovs_interfaceid": "c94c3e52-300f-4b5f-8942-08c95eab4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG os_vif [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc94c3e52-30, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1788144b-ea45-454f-9819-909c53fc3b9e) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:52 user nova-compute[75244]: INFO os_vif [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=c94c3e52-300f-4b5f-8942-08c95eab4cfe,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc94c3e52-30')
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Deleting instance files /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796_del
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Deletion of /opt/stack/data/nova/instances/49d04f90-df1c-4cfb-84d5-8759a5871796_del complete
Nov 29 23:08:52 user nova-compute[75244]: INFO nova.compute.manager [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 29 23:08:52 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:08:52 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:08:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Creating image(s)
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Ensure instance console log exists: /opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Start _get_guest_xml network_info=[{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f285c6d6-ccb5-419a-94df-0d608f08c33c', 'attached_at': '', 'detached_at': '', 'volume_id': '1c294d3d-4c05-473a-a2dc-95a642351df8', 'serial': '1c294d3d-4c05-473a-a2dc-95a642351df8'}, 'attachment_id': 'eb8f19fe-3824-48fd-ab0c-3c4babbf753c', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:08:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 23:08:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lazy-loading 'vcpu_model' on Instance uuid f285c6d6-ccb5-419a-94df-0d608f08c33c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:08:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:08:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:08:53 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64f29d-e08d-4817-b06b-6a2641ebab72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:08:53 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a0c98-9a58-4eff-9b2e-2e762347032d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8] added
Nov 29 23:08:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c8c30f-ce97-4ba7-8fc1-f900f5f5197c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0724e-5dee-47de-b2ac-8f920450899d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCRYaZwx {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCRYaZwx" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd65bbf-d30f-40f2-a073-63015dadcab2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCRYaZwx'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce85212-cf3a-48dd-a3fd-39ab0fd0cebc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37716637-79cf-4b89-9eaf-cbbbc962732b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fc99ab-392d-4408-8f07-2fba368b8efd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]
Nov 29 23:08:54 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.
Nov 29 23:08:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[79211fe1-f08a-4b9b-84f3-8d56df4d2523]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf79774-a630-434a-9acf-8ca8c2ab324d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:08:54 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38a633b-a2e1-496e-966e-be93441ee217]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:08:54 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Took 1.42 seconds to deallocate network for instance.
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] Acquiring lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] No waiting events found dispatching network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:54 user nova-compute[75244]: WARNING nova.compute.manager [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received unexpected event network-vif-plugged-c94c3e52-300f-4b5f-8942-08c95eab4cfe for instance with vm_state deleted and task_state None.
Nov 29 23:08:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-89b3d407-3aee-43e4-ab6b-98b15728d613 req-679e4aa0-8727-4e5d-8ce3-d8021f5d557f service nova] [instance: 49d04f90-df1c-4cfb-84d5-8759a5871796] Received event network-vif-deleted-c94c3e52-300f-4b5f-8942-08c95eab4cfe {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:54 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Deleted allocations for instance 49d04f90-df1c-4cfb-84d5-8759a5871796
Nov 29 23:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ad7509e2-7c40-4412-b670-6f3b2e16a00f tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "49d04f90-df1c-4cfb-84d5-8759a5871796" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.804s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23330336537326332', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330336537326332', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1985742742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1038057022',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5E3Tsq5bbF9bdpJnsYkIAIienF8hmPQXzNUhNp2gKZCBRd+lp43mKtu7gxh++Wp6Li9ezdn0RmsDzgcwlFYEzAWJqfRjy5edd4uf7DcDG3fiiq9ZHensfgVJTB4AOg==',key_name='tempest-keypair-637915247',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c65023bfd4a461fbbc63d2c08d930a8',ramdisk_id='',reservation_id='r-br52rfyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439423886',owner_user_name='tempest-ServerActionsV293TestJSON-439423886-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd93ba0909bd44dfae59be5b157cb0cf',uuid=f285c6d6-ccb5-419a-94df-0d608f08c33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converting VIF {"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:08:55 user nova-compute[75244]:   <uuid>f285c6d6-ccb5-419a-94df-0d608f08c33c</uuid>
Nov 29 23:08:55 user nova-compute[75244]:   <name>instance-00000010</name>
Nov 29 23:08:55 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:08:55 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:08:55 user nova-compute[75244]:   <metadata>
Nov 29 23:08:55 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:08:55 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:08:55 user nova-compute[75244]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1985742742</nova:name>
Nov 29 23:08:55 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:08:53</nova:creationTime>
Nov 29 23:08:55 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:08:55 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:08:55 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:08:55 user nova-compute[75244]:       <nova:owner>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:user uuid="dd93ba0909bd44dfae59be5b157cb0cf">tempest-ServerActionsV293TestJSON-439423886-project-member</nova:user>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:project uuid="7c65023bfd4a461fbbc63d2c08d930a8">tempest-ServerActionsV293TestJSON-439423886</nova:project>
Nov 29 23:08:55 user nova-compute[75244]:       </nova:owner>
Nov 29 23:08:55 user nova-compute[75244]:       <nova:ports>
Nov 29 23:08:55 user nova-compute[75244]:         <nova:port uuid="475156ec-7744-46e6-95f8-9703c9f6f777">
Nov 29 23:08:55 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 23:08:55 user nova-compute[75244]:         </nova:port>
Nov 29 23:08:55 user nova-compute[75244]:       </nova:ports>
Nov 29 23:08:55 user nova-compute[75244]:     </nova:instance>
Nov 29 23:08:55 user nova-compute[75244]:   </metadata>
Nov 29 23:08:55 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:08:55 user nova-compute[75244]:     <system>
Nov 29 23:08:55 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:08:55 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:08:55 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:08:55 user nova-compute[75244]:       <entry name="serial">f285c6d6-ccb5-419a-94df-0d608f08c33c</entry>
Nov 29 23:08:55 user nova-compute[75244]:       <entry name="uuid">f285c6d6-ccb5-419a-94df-0d608f08c33c</entry>
Nov 29 23:08:55 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:08:55 user nova-compute[75244]:     </system>
Nov 29 23:08:55 user nova-compute[75244]:   </sysinfo>
Nov 29 23:08:55 user nova-compute[75244]:   <os>
Nov 29 23:08:55 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:08:55 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:08:55 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:08:55 user nova-compute[75244]:   </os>
Nov 29 23:08:55 user nova-compute[75244]:   <features>
Nov 29 23:08:55 user nova-compute[75244]:     <acpi/>
Nov 29 23:08:55 user nova-compute[75244]:     <apic/>
Nov 29 23:08:55 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:08:55 user nova-compute[75244]:   </features>
Nov 29 23:08:55 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:08:55 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:08:55 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:08:55 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:08:55 user nova-compute[75244]:   </clock>
Nov 29 23:08:55 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:08:55 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:08:55 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:08:55 user nova-compute[75244]:   </cpu>
Nov 29 23:08:55 user nova-compute[75244]:   <devices>
Nov 29 23:08:55 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:08:55 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:08:55 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:08:55 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:08:55 user nova-compute[75244]:       <serial>1c294d3d-4c05-473a-a2dc-95a642351df8</serial>
Nov 29 23:08:55 user nova-compute[75244]:     </disk>
Nov 29 23:08:55 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:08:55 user nova-compute[75244]:       <mac address="fa:16:3e:39:ab:a5"/>
Nov 29 23:08:55 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:08:55 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:08:55 user nova-compute[75244]:       <target dev="tap475156ec-77"/>
Nov 29 23:08:55 user nova-compute[75244]:     </interface>
Nov 29 23:08:55 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:08:55 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c/console.log" append="off"/>
Nov 29 23:08:55 user nova-compute[75244]:     </serial>
Nov 29 23:08:55 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:08:55 user nova-compute[75244]:     <video>
Nov 29 23:08:55 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:08:55 user nova-compute[75244]:     </video>
Nov 29 23:08:55 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:08:55 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:08:55 user nova-compute[75244]:     </rng>
Nov 29 23:08:55 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:08:55 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:08:55 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:08:55 user nova-compute[75244]:     </memballoon>
Nov 29 23:08:55 user nova-compute[75244]:   </devices>
Nov 29 23:08:55 user nova-compute[75244]: </domain>
Nov 29 23:08:55 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1985742742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1038057022',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5E3Tsq5bbF9bdpJnsYkIAIienF8hmPQXzNUhNp2gKZCBRd+lp43mKtu7gxh++Wp6Li9ezdn0RmsDzgcwlFYEzAWJqfRjy5edd4uf7DcDG3fiiq9ZHensfgVJTB4AOg==',key_name='tempest-keypair-637915247',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c65023bfd4a461fbbc63d2c08d930a8',ramdisk_id='',reservation_id='r-br52rfyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439423886',owner_user_name='tempest-ServerActionsV293TestJSON-439423886-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd93ba0909bd44dfae59be5b157cb0cf',uuid=f285c6d6-ccb5-419a-94df-0d608f08c33c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converting VIF {"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG os_vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ece7265-a62a-5370-9544-e01ae6501a8b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap475156ec-77, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap475156ec-77, col_values=(('qos', UUID('903337a7-054e-43ce-8d3c-cc034957a28f')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap475156ec-77, col_values=(('external_ids', {'iface-id': '475156ec-7744-46e6-95f8-9703c9f6f777', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ab:a5', 'vm-uuid': 'f285c6d6-ccb5-419a-94df-0d608f08c33c'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: INFO os_vif [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77')
Nov 29 23:08:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] No VIF found with MAC fa:16:3e:39:ab:a5, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:08:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-22706609-1e6e-4581-82af-bd5c35fe72ff req-a1615625-5849-47de-a2b3-df373e88495a service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-22706609-1e6e-4581-82af-bd5c35fe72ff req-a1615625-5849-47de-a2b3-df373e88495a service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-22706609-1e6e-4581-82af-bd5c35fe72ff req-a1615625-5849-47de-a2b3-df373e88495a service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-22706609-1e6e-4581-82af-bd5c35fe72ff req-a1615625-5849-47de-a2b3-df373e88495a service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-22706609-1e6e-4581-82af-bd5c35fe72ff req-a1615625-5849-47de-a2b3-df373e88495a service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:57 user nova-compute[75244]: WARNING nova.compute.manager [req-22706609-1e6e-4581-82af-bd5c35fe72ff req-a1615625-5849-47de-a2b3-df373e88495a service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 23:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:08:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance spawned successfully.
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-45102e51-0c80-4af0-ab69-8126bbcc452a req-c5b3a701-7207-4d49-86d0-a7933fd7607c service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-45102e51-0c80-4af0-ab69-8126bbcc452a req-c5b3a701-7207-4d49-86d0-a7933fd7607c service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-45102e51-0c80-4af0-ab69-8126bbcc452a req-c5b3a701-7207-4d49-86d0-a7933fd7607c service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-45102e51-0c80-4af0-ab69-8126bbcc452a req-c5b3a701-7207-4d49-86d0-a7933fd7607c service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-45102e51-0c80-4af0-ab69-8126bbcc452a req-c5b3a701-7207-4d49-86d0-a7933fd7607c service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:08:59 user nova-compute[75244]: WARNING nova.compute.manager [req-45102e51-0c80-4af0-ab69-8126bbcc452a req-c5b3a701-7207-4d49-86d0-a7933fd7607c service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 23:08:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75244) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6371a5de-c960-430b-90d3-f36e3d675cdd tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:08:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:09:10 user nova-compute[75244]: INFO nova.compute.claims [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Claim successful on node user
Nov 29 23:09:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.network.neutron [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:09:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:09:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG nova.policy [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34cc981cad504120ac7e4507e9c08fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555c96d9ec5c48fe814663a5cdd84ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:09:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Creating image(s)
Nov 29 23:09:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "/opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "/opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "/opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "e04ab15635840005835671e3926b8b28a444bd8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "e04ab15635840005835671e3926b8b28a444bd8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG nova.virt.images [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] a2c034e3-5b5c-4756-95f5-5f1fc5eafd81 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.part /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Successfully created port: 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.part /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.converted" returned: 0 in 0.298s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:09:12 user nova-compute[75244]: INFO nova.compute.claims [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Claim successful on node user
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "e04ab15635840005835671e3926b8b28a444bd8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.398s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e --force-share --output=json" returned: 0 in 0.242s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "e04ab15635840005835671e3926b8b28a444bd8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "e04ab15635840005835671e3926b8b28a444bd8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:12 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e,backing_fmt=raw /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Successfully updated port: 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-changed-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing instance network info cache due to event network-changed-17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e,backing_fmt=raw /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk 1073741824" returned: 0 in 0.083s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "e04ab15635840005835671e3926b8b28a444bd8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.policy [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '579c42ce8eec4d1da0554d4797bde030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2752170d04b4e3da54e0f7aa8d57e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e --force-share --output=json" returned: 0 in 0.237s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:09:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Creating image(s)
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Cannot resize image /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Ensure instance console log exists: /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f3492b8-4ea3-4172-b3da-da59f9c4a6f2 req-cc67814a-5abb-454f-8ab9-867f7de2e8ea service nova] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk 1073741824" returned: 0 in 0.075s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.241s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Cannot resize image /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Ensure instance console log exists: /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance network_info: |[{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Start _get_guest_xml network_info=[{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T23:09:07Z,direct_url=<?>,disk_format='qcow2',id=a2c034e3-5b5c-4756-95f5-5f1fc5eafd81,min_disk=0,min_ram=0,name='tempest-scenario-img--2011695626',owner='555c96d9ec5c48fe814663a5cdd84ffa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T23:09:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'a2c034e3-5b5c-4756-95f5-5f1fc5eafd81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:09:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T23:09:07Z,direct_url=<?>,disk_format='qcow2',id=a2c034e3-5b5c-4756-95f5-5f1fc5eafd81,min_disk=0,min_ram=0,name='tempest-scenario-img--2011695626',owner='555c96d9ec5c48fe814663a5cdd84ffa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T23:09:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612060254',display_name='tempest-TestMinimumBasicScenario-server-612060254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612060254',id=20,image_ref='a2c034e3-5b5c-4756-95f5-5f1fc5eafd81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+Jt6pSeBdZJGu0jj1pGvMBKZy+lwjcDiBXteI7METI/I4CmTyh8Y7K9gKH4ev2qmG0tHtVO45BXGsYCEij/vpSVmxFp7vI67LUS9HjjsGjug//GAzopCMxNLFK6utOuQ==',key_name='tempest-TestMinimumBasicScenario-1932079665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-cwy1c0qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a2c034e3-5b5c-4756-95f5-5f1fc5eafd81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:11Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=5eadf8f0-a801-47b5-99d8-34812a0d83db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.objects.instance [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'pci_devices' on Instance uuid 5eadf8f0-a801-47b5-99d8-34812a0d83db {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Successfully created port: beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:09:14 user nova-compute[75244]:   <uuid>5eadf8f0-a801-47b5-99d8-34812a0d83db</uuid>
Nov 29 23:09:14 user nova-compute[75244]:   <name>instance-00000014</name>
Nov 29 23:09:14 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:09:14 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:09:14 user nova-compute[75244]:   <metadata>
Nov 29 23:09:14 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:09:14 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:09:14 user nova-compute[75244]:       <nova:name>tempest-TestMinimumBasicScenario-server-612060254</nova:name>
Nov 29 23:09:14 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:09:14</nova:creationTime>
Nov 29 23:09:14 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:09:14 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:09:14 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:09:14 user nova-compute[75244]:       <nova:owner>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:user uuid="34cc981cad504120ac7e4507e9c08fcd">tempest-TestMinimumBasicScenario-1628079571-project-member</nova:user>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:project uuid="555c96d9ec5c48fe814663a5cdd84ffa">tempest-TestMinimumBasicScenario-1628079571</nova:project>
Nov 29 23:09:14 user nova-compute[75244]:       </nova:owner>
Nov 29 23:09:14 user nova-compute[75244]:       <nova:root type="image" uuid="a2c034e3-5b5c-4756-95f5-5f1fc5eafd81"/>
Nov 29 23:09:14 user nova-compute[75244]:       <nova:ports>
Nov 29 23:09:14 user nova-compute[75244]:         <nova:port uuid="17d779a7-8523-4a82-a9da-534db4d80939">
Nov 29 23:09:14 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 23:09:14 user nova-compute[75244]:         </nova:port>
Nov 29 23:09:14 user nova-compute[75244]:       </nova:ports>
Nov 29 23:09:14 user nova-compute[75244]:     </nova:instance>
Nov 29 23:09:14 user nova-compute[75244]:   </metadata>
Nov 29 23:09:14 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:09:14 user nova-compute[75244]:     <system>
Nov 29 23:09:14 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:09:14 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:09:14 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:09:14 user nova-compute[75244]:       <entry name="serial">5eadf8f0-a801-47b5-99d8-34812a0d83db</entry>
Nov 29 23:09:14 user nova-compute[75244]:       <entry name="uuid">5eadf8f0-a801-47b5-99d8-34812a0d83db</entry>
Nov 29 23:09:14 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:09:14 user nova-compute[75244]:     </system>
Nov 29 23:09:14 user nova-compute[75244]:   </sysinfo>
Nov 29 23:09:14 user nova-compute[75244]:   <os>
Nov 29 23:09:14 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:09:14 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:09:14 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:09:14 user nova-compute[75244]:   </os>
Nov 29 23:09:14 user nova-compute[75244]:   <features>
Nov 29 23:09:14 user nova-compute[75244]:     <acpi/>
Nov 29 23:09:14 user nova-compute[75244]:     <apic/>
Nov 29 23:09:14 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:09:14 user nova-compute[75244]:   </features>
Nov 29 23:09:14 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:09:14 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:09:14 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:09:14 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:09:14 user nova-compute[75244]:   </clock>
Nov 29 23:09:14 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:09:14 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:09:14 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:09:14 user nova-compute[75244]:   </cpu>
Nov 29 23:09:14 user nova-compute[75244]:   <devices>
Nov 29 23:09:14 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:09:14 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:09:14 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk"/>
Nov 29 23:09:14 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:09:14 user nova-compute[75244]:     </disk>
Nov 29 23:09:14 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:09:14 user nova-compute[75244]:       <mac address="fa:16:3e:d9:c1:0a"/>
Nov 29 23:09:14 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:14 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:09:14 user nova-compute[75244]:       <target dev="tap17d779a7-85"/>
Nov 29 23:09:14 user nova-compute[75244]:     </interface>
Nov 29 23:09:14 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:09:14 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/console.log" append="off"/>
Nov 29 23:09:14 user nova-compute[75244]:     </serial>
Nov 29 23:09:14 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:09:14 user nova-compute[75244]:     <video>
Nov 29 23:09:14 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:14 user nova-compute[75244]:     </video>
Nov 29 23:09:14 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:09:14 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:09:14 user nova-compute[75244]:     </rng>
Nov 29 23:09:14 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:09:14 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:09:14 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:09:14 user nova-compute[75244]:     </memballoon>
Nov 29 23:09:14 user nova-compute[75244]:   </devices>
Nov 29 23:09:14 user nova-compute[75244]: </domain>
Nov 29 23:09:14 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612060254',display_name='tempest-TestMinimumBasicScenario-server-612060254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612060254',id=20,image_ref='a2c034e3-5b5c-4756-95f5-5f1fc5eafd81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+Jt6pSeBdZJGu0jj1pGvMBKZy+lwjcDiBXteI7METI/I4CmTyh8Y7K9gKH4ev2qmG0tHtVO45BXGsYCEij/vpSVmxFp7vI67LUS9HjjsGjug//GAzopCMxNLFK6utOuQ==',key_name='tempest-TestMinimumBasicScenario-1932079665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-cwy1c0qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a2c034e3-5b5c-4756-95f5-5f1fc5eafd81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:11Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=5eadf8f0-a801-47b5-99d8-34812a0d83db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG os_vif [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a2a54a8-6e41-57bb-a007-bcf5ec8950ed', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17d779a7-85, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17d779a7-85, col_values=(('qos', UUID('490f0bf9-acb1-4ce7-a9e8-8d8bb20923b4')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17d779a7-85, col_values=(('external_ids', {'iface-id': '17d779a7-8523-4a82-a9da-534db4d80939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:c1:0a', 'vm-uuid': '5eadf8f0-a801-47b5-99d8-34812a0d83db'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:14 user nova-compute[75244]: INFO os_vif [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85')
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:09:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No VIF found with MAC fa:16:3e:d9:c1:0a, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:09:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Successfully updated port: beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:09:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance network_info: |[{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start _get_guest_xml network_info=[{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-changed-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Refreshing instance network info cache due to event network-changed-beb2df2b-5192-4d17-8e62-09c480ce6e36. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Refreshing network info cache for port beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:16 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'pci_devices' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:09:16 user nova-compute[75244]:   <uuid>7156169f-5668-49cb-93dc-35009dfff4c4</uuid>
Nov 29 23:09:16 user nova-compute[75244]:   <name>instance-00000015</name>
Nov 29 23:09:16 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:09:16 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:09:16 user nova-compute[75244]:   <metadata>
Nov 29 23:09:16 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:09:16 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:09:16 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherB-server-986679095</nova:name>
Nov 29 23:09:16 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:09:16</nova:creationTime>
Nov 29 23:09:16 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:09:16 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:09:16 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:09:16 user nova-compute[75244]:       <nova:owner>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:user uuid="579c42ce8eec4d1da0554d4797bde030">tempest-ServerActionsTestOtherB-1460963367-project-member</nova:user>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:project uuid="e2752170d04b4e3da54e0f7aa8d57e94">tempest-ServerActionsTestOtherB-1460963367</nova:project>
Nov 29 23:09:16 user nova-compute[75244]:       </nova:owner>
Nov 29 23:09:16 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:09:16 user nova-compute[75244]:       <nova:ports>
Nov 29 23:09:16 user nova-compute[75244]:         <nova:port uuid="beb2df2b-5192-4d17-8e62-09c480ce6e36">
Nov 29 23:09:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:09:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:09:16 user nova-compute[75244]:       </nova:ports>
Nov 29 23:09:16 user nova-compute[75244]:     </nova:instance>
Nov 29 23:09:16 user nova-compute[75244]:   </metadata>
Nov 29 23:09:16 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:09:16 user nova-compute[75244]:     <system>
Nov 29 23:09:16 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:09:16 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:09:16 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:09:16 user nova-compute[75244]:       <entry name="serial">7156169f-5668-49cb-93dc-35009dfff4c4</entry>
Nov 29 23:09:16 user nova-compute[75244]:       <entry name="uuid">7156169f-5668-49cb-93dc-35009dfff4c4</entry>
Nov 29 23:09:16 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:09:16 user nova-compute[75244]:     </system>
Nov 29 23:09:16 user nova-compute[75244]:   </sysinfo>
Nov 29 23:09:16 user nova-compute[75244]:   <os>
Nov 29 23:09:16 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:09:16 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:09:16 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:09:16 user nova-compute[75244]:   </os>
Nov 29 23:09:16 user nova-compute[75244]:   <features>
Nov 29 23:09:16 user nova-compute[75244]:     <acpi/>
Nov 29 23:09:16 user nova-compute[75244]:     <apic/>
Nov 29 23:09:16 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:09:16 user nova-compute[75244]:   </features>
Nov 29 23:09:16 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:09:16 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:09:16 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:09:16 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:09:16 user nova-compute[75244]:   </clock>
Nov 29 23:09:16 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:09:16 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:09:16 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:09:16 user nova-compute[75244]:   </cpu>
Nov 29 23:09:16 user nova-compute[75244]:   <devices>
Nov 29 23:09:16 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:09:16 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:09:16 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk"/>
Nov 29 23:09:16 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:09:16 user nova-compute[75244]:     </disk>
Nov 29 23:09:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:09:16 user nova-compute[75244]:       <mac address="fa:16:3e:79:3f:62"/>
Nov 29 23:09:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:09:16 user nova-compute[75244]:       <target dev="tapbeb2df2b-51"/>
Nov 29 23:09:16 user nova-compute[75244]:     </interface>
Nov 29 23:09:16 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:09:16 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/console.log" append="off"/>
Nov 29 23:09:16 user nova-compute[75244]:     </serial>
Nov 29 23:09:16 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:09:16 user nova-compute[75244]:     <video>
Nov 29 23:09:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:16 user nova-compute[75244]:     </video>
Nov 29 23:09:16 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:09:16 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:09:16 user nova-compute[75244]:     </rng>
Nov 29 23:09:16 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:09:16 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:09:16 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:09:16 user nova-compute[75244]:     </memballoon>
Nov 29 23:09:16 user nova-compute[75244]:   </devices>
Nov 29 23:09:16 user nova-compute[75244]: </domain>
Nov 29 23:09:16 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG os_vif [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5342bdf7-4f4b-5008-a689-b0c8ce1a60f9', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeb2df2b-51, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbeb2df2b-51, col_values=(('qos', UUID('9f90119b-e02b-458b-a157-2ea4f80910cd')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbeb2df2b-51, col_values=(('external_ids', {'iface-id': 'beb2df2b-5192-4d17-8e62-09c480ce6e36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:3f:62', 'vm-uuid': '7156169f-5668-49cb-93dc-35009dfff4c4'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:16 user nova-compute[75244]: INFO os_vif [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51')
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:09:16 user nova-compute[75244]: INFO nova.compute.claims [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Claim successful on node user
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No VIF found with MAC fa:16:3e:79:3f:62, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-297f37c9-020f-49ec-a9a7-f80272940c60 req-9bcb8d73-da04-4673-8a02-85dc0fa1434f service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-297f37c9-020f-49ec-a9a7-f80272940c60 req-9bcb8d73-da04-4673-8a02-85dc0fa1434f service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-297f37c9-020f-49ec-a9a7-f80272940c60 req-9bcb8d73-da04-4673-8a02-85dc0fa1434f service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-297f37c9-020f-49ec-a9a7-f80272940c60 req-9bcb8d73-da04-4673-8a02-85dc0fa1434f service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-297f37c9-020f-49ec-a9a7-f80272940c60 req-9bcb8d73-da04-4673-8a02-85dc0fa1434f service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:16 user nova-compute[75244]: WARNING nova.compute.manager [req-297f37c9-020f-49ec-a9a7-f80272940c60 req-9bcb8d73-da04-4673-8a02-85dc0fa1434f service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state building and task_state spawning.
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updated VIF entry in instance network info cache for port beb2df2b-5192-4d17-8e62-09c480ce6e36. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f1d8e54a-3a90-448a-917e-2e306c5ee22e req-6c21a1da-d55b-4d9c-b28f-04c46646ad1e service nova] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:09:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.policy [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe39bc0caf6f49368d0d0cb0789a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b273a67b0a2f462aa1092779f31fdc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:09:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Creating image(s)
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk 1073741824" returned: 0 in 0.121s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Successfully created port: e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.209s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:09:18 user nova-compute[75244]: INFO nova.compute.claims [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Claim successful on node user
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Cannot resize image /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Ensure instance console log exists: /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a865101-0c15-4b17-a0fe-8ad3f71a69f5 req-1f87efb3-a5df-4762-865a-0b1be27da5dd service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a865101-0c15-4b17-a0fe-8ad3f71a69f5 req-1f87efb3-a5df-4762-865a-0b1be27da5dd service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a865101-0c15-4b17-a0fe-8ad3f71a69f5 req-1f87efb3-a5df-4762-865a-0b1be27da5dd service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a865101-0c15-4b17-a0fe-8ad3f71a69f5 req-1f87efb3-a5df-4762-865a-0b1be27da5dd service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a865101-0c15-4b17-a0fe-8ad3f71a69f5 req-1f87efb3-a5df-4762-865a-0b1be27da5dd service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:18 user nova-compute[75244]: WARNING nova.compute.manager [req-1a865101-0c15-4b17-a0fe-8ad3f71a69f5 req-1f87efb3-a5df-4762-865a-0b1be27da5dd service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state building and task_state spawning.
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Successfully updated port: e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:09:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance spawned successfully.
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-changed-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing instance network info cache due to event network-changed-e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-590829de-79f7-494b-bd6e-ee8ce9a1514e req-9d061601-bb13-45ed-9162-85abc5560e1c service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-590829de-79f7-494b-bd6e-ee8ce9a1514e req-9d061601-bb13-45ed-9162-85abc5560e1c service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-590829de-79f7-494b-bd6e-ee8ce9a1514e req-9d061601-bb13-45ed-9162-85abc5560e1c service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-590829de-79f7-494b-bd6e-ee8ce9a1514e req-9d061601-bb13-45ed-9162-85abc5560e1c service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-590829de-79f7-494b-bd6e-ee8ce9a1514e req-9d061601-bb13-45ed-9162-85abc5560e1c service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:18 user nova-compute[75244]: WARNING nova.compute.manager [req-590829de-79f7-494b-bd6e-ee8ce9a1514e req-9d061601-bb13-45ed-9162-85abc5560e1c service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state building and task_state spawning.
Nov 29 23:09:18 user nova-compute[75244]: INFO nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:09:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:09:19 user nova-compute[75244]: INFO nova.compute.manager [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Took 8.74 seconds to build instance.
Nov 29 23:09:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-1c24bcfc-4abc-4154-93c6-3b47b1660b57 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.852s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:09:19 user nova-compute[75244]: INFO nova.virt.block_device [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Booting with volume 8cf0e830-0613-46a9-badd-bca0a18cd8af at /dev/vda
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_brick.utils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[971400df-a3f3-4722-add6-6c6b4229d5c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.policy [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '476af5a1d41146788ce60db8a2683f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0258ba7ccde40a09e3e251fbef77431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911cc91-18fc-4438-9d96-c3d164bd6f94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe9a20-e8d1-4618-bef0-cfadec2d0a62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd14a8f-5582-4b1f-9957-55511bb7968c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance network_info: |[{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:09:19 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e8ddb3-21b4-498a-ab57-60f41eeb483e]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing network info cache for port e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Start _get_guest_xml network_info=[{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_brick.utils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating existing volume attachment record: 608a8b76-1e18-453c-bf8c-f3aee6da55aa {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:09:19 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:19 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486852029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486852029',id=22,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCC67DzG1riKGxi2wUbXu8EmjvRfVhTQnD6socBdd5qUlfc30W3AZ8lpHpQVcfr3eD3zoaTTFqx/r9VKbu1vB5DLu34KfDPjQJ4BRFCCjn7VFZOTWVP+WvaxudiQmh0Lw==',key_name='tempest-keypair-17102318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-d87zlrs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=24054fdc-8f5e-4352-bdfa-717f288152bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'pci_devices' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:09:19 user nova-compute[75244]:   <uuid>24054fdc-8f5e-4352-bdfa-717f288152bf</uuid>
Nov 29 23:09:19 user nova-compute[75244]:   <name>instance-00000016</name>
Nov 29 23:09:19 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:09:19 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:09:19 user nova-compute[75244]:   <metadata>
Nov 29 23:09:19 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:09:19 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:09:19 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1486852029</nova:name>
Nov 29 23:09:19 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:09:19</nova:creationTime>
Nov 29 23:09:19 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:09:19 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:09:19 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:09:19 user nova-compute[75244]:       <nova:owner>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:user uuid="fe39bc0caf6f49368d0d0cb0789a1d3c">tempest-AttachVolumeShelveTestJSON-576906296-project-member</nova:user>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:project uuid="b273a67b0a2f462aa1092779f31fdc8a">tempest-AttachVolumeShelveTestJSON-576906296</nova:project>
Nov 29 23:09:19 user nova-compute[75244]:       </nova:owner>
Nov 29 23:09:19 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:09:19 user nova-compute[75244]:       <nova:ports>
Nov 29 23:09:19 user nova-compute[75244]:         <nova:port uuid="e96d8f49-a385-4553-805a-a353f62944ac">
Nov 29 23:09:19 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 23:09:19 user nova-compute[75244]:         </nova:port>
Nov 29 23:09:19 user nova-compute[75244]:       </nova:ports>
Nov 29 23:09:19 user nova-compute[75244]:     </nova:instance>
Nov 29 23:09:19 user nova-compute[75244]:   </metadata>
Nov 29 23:09:19 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:09:19 user nova-compute[75244]:     <system>
Nov 29 23:09:19 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:09:19 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:09:19 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:09:19 user nova-compute[75244]:       <entry name="serial">24054fdc-8f5e-4352-bdfa-717f288152bf</entry>
Nov 29 23:09:19 user nova-compute[75244]:       <entry name="uuid">24054fdc-8f5e-4352-bdfa-717f288152bf</entry>
Nov 29 23:09:19 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:09:19 user nova-compute[75244]:     </system>
Nov 29 23:09:19 user nova-compute[75244]:   </sysinfo>
Nov 29 23:09:19 user nova-compute[75244]:   <os>
Nov 29 23:09:19 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:09:19 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:09:19 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:09:19 user nova-compute[75244]:   </os>
Nov 29 23:09:19 user nova-compute[75244]:   <features>
Nov 29 23:09:19 user nova-compute[75244]:     <acpi/>
Nov 29 23:09:19 user nova-compute[75244]:     <apic/>
Nov 29 23:09:19 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:09:19 user nova-compute[75244]:   </features>
Nov 29 23:09:19 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:09:19 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:09:19 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:09:19 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:09:19 user nova-compute[75244]:   </clock>
Nov 29 23:09:19 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:09:19 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:09:19 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:09:19 user nova-compute[75244]:   </cpu>
Nov 29 23:09:19 user nova-compute[75244]:   <devices>
Nov 29 23:09:19 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:09:19 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:09:19 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk"/>
Nov 29 23:09:19 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:09:19 user nova-compute[75244]:     </disk>
Nov 29 23:09:19 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:09:19 user nova-compute[75244]:       <mac address="fa:16:3e:e0:63:10"/>
Nov 29 23:09:19 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:19 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:09:19 user nova-compute[75244]:       <target dev="tape96d8f49-a3"/>
Nov 29 23:09:19 user nova-compute[75244]:     </interface>
Nov 29 23:09:19 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:09:19 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/console.log" append="off"/>
Nov 29 23:09:19 user nova-compute[75244]:     </serial>
Nov 29 23:09:19 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:09:19 user nova-compute[75244]:     <video>
Nov 29 23:09:19 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:19 user nova-compute[75244]:     </video>
Nov 29 23:09:19 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:09:19 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:09:19 user nova-compute[75244]:     </rng>
Nov 29 23:09:19 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:09:19 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:09:19 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:09:19 user nova-compute[75244]:     </memballoon>
Nov 29 23:09:19 user nova-compute[75244]:   </devices>
Nov 29 23:09:19 user nova-compute[75244]: </domain>
Nov 29 23:09:19 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486852029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486852029',id=22,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCC67DzG1riKGxi2wUbXu8EmjvRfVhTQnD6socBdd5qUlfc30W3AZ8lpHpQVcfr3eD3zoaTTFqx/r9VKbu1vB5DLu34KfDPjQJ4BRFCCjn7VFZOTWVP+WvaxudiQmh0Lw==',key_name='tempest-keypair-17102318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-d87zlrs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=24054fdc-8f5e-4352-bdfa-717f288152bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG os_vif [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba0ca094-dd26-5d45-8aef-dbcd4cddf892', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape96d8f49-a3, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape96d8f49-a3, col_values=(('qos', UUID('5abd6d6a-5f51-419a-9f07-1c25cc2bc8a2')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape96d8f49-a3, col_values=(('external_ids', {'iface-id': 'e96d8f49-a385-4553-805a-a353f62944ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:63:10', 'vm-uuid': '24054fdc-8f5e-4352-bdfa-717f288152bf'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:19 user nova-compute[75244]: INFO os_vif [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3')
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No VIF found with MAC fa:16:3e:e0:63:10, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updated VIF entry in instance network info cache for port e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff1419a6-3d82-49bb-92fc-7c833541a55d req-e8d4565a-05f4-41a4-b7c4-10b3ca266da6 service nova] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Successfully created port: cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-f8a74ead-7cfb-449b-82bb-76b6ab7afe56 req-eb03a24c-df27-44df-b327-45efc44359fa service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8a74ead-7cfb-449b-82bb-76b6ab7afe56 req-eb03a24c-df27-44df-b327-45efc44359fa service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8a74ead-7cfb-449b-82bb-76b6ab7afe56 req-eb03a24c-df27-44df-b327-45efc44359fa service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8a74ead-7cfb-449b-82bb-76b6ab7afe56 req-eb03a24c-df27-44df-b327-45efc44359fa service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-f8a74ead-7cfb-449b-82bb-76b6ab7afe56 req-eb03a24c-df27-44df-b327-45efc44359fa service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:20 user nova-compute[75244]: WARNING nova.compute.manager [req-f8a74ead-7cfb-449b-82bb-76b6ab7afe56 req-eb03a24c-df27-44df-b327-45efc44359fa service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state building and task_state spawning.
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Successfully updated port: cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:09:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance spawned successfully.
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing instance network info cache due to event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:21 user nova-compute[75244]: INFO nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Took 7.52 seconds to spawn the instance on the hypervisor.
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:09:21 user nova-compute[75244]: INFO nova.compute.manager [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Took 8.74 seconds to build instance.
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f2106994-7e35-4eb5-b86f-3ca081de6ae6 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.956s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance network_info: |[{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.network.neutron [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-8b7c513f-90a4-4034-b987-b07fc18b00eb req-14d45104-45fd-438d-b8ea-f5edb521c2d8 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8b7c513f-90a4-4034-b987-b07fc18b00eb req-14d45104-45fd-438d-b8ea-f5edb521c2d8 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8b7c513f-90a4-4034-b987-b07fc18b00eb req-14d45104-45fd-438d-b8ea-f5edb521c2d8 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8b7c513f-90a4-4034-b987-b07fc18b00eb req-14d45104-45fd-438d-b8ea-f5edb521c2d8 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-8b7c513f-90a4-4034-b987-b07fc18b00eb req-14d45104-45fd-438d-b8ea-f5edb521c2d8 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:21 user nova-compute[75244]: WARNING nova.compute.manager [req-8b7c513f-90a4-4034-b987-b07fc18b00eb req-14d45104-45fd-438d-b8ea-f5edb521c2d8 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state building and task_state spawning.
Nov 29 23:09:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.network.neutron [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updated VIF entry in instance network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG nova.network.neutron [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6a7349c2-146b-47a6-851c-7bcabf1902eb req-1ddf0cb7-6dc6-4783-854d-85eeff5674e3 service nova] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-b4f5076a-3db1-462a-a060-9cdc1165753e req-d6735477-245f-4191-80a2-815f3051cf88 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b4f5076a-3db1-462a-a060-9cdc1165753e req-d6735477-245f-4191-80a2-815f3051cf88 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b4f5076a-3db1-462a-a060-9cdc1165753e req-d6735477-245f-4191-80a2-815f3051cf88 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b4f5076a-3db1-462a-a060-9cdc1165753e req-d6735477-245f-4191-80a2-815f3051cf88 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-b4f5076a-3db1-462a-a060-9cdc1165753e req-d6735477-245f-4191-80a2-815f3051cf88 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:23 user nova-compute[75244]: WARNING nova.compute.manager [req-b4f5076a-3db1-462a-a060-9cdc1165753e req-d6735477-245f-4191-80a2-815f3051cf88 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state building and task_state spawning.
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:09:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance spawned successfully.
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:23 user nova-compute[75244]: INFO nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 29 23:09:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:09:23 user nova-compute[75244]: INFO nova.compute.manager [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Took 7.45 seconds to build instance.
Nov 29 23:09:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5f79f3c7-f941-4e00-8f73-0e5ede4696d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.714s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:09:28 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Creating image(s)
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Ensure instance console log exists: /opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Start _get_guest_xml network_info=[{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '089b181a-b746-4a25-94ad-50fd268a7cd9', 'attached_at': '', 'detached_at': '', 'volume_id': '8cf0e830-0613-46a9-badd-bca0a18cd8af', 'serial': '8cf0e830-0613-46a9-badd-bca0a18cd8af'}, 'attachment_id': '608a8b76-1e18-453c-bf8c-f3aee6da55aa', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:09:28 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:28 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:09:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:09:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:09:28 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df2e6a-83b9-43ac-8c42-3c41ffce327c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:09:28 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fbfc4f-87b8-417f-b60e-d83da50c7793]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af] added
Nov 29 23:09:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.117s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9e601-68ae-416d-8fc0-4b662d1003a6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c94ef5-092b-4400-aee5-b29710d066a6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMwJnuRL {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMwJnuRL" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f98746b-aa4d-4a8b-a4fe-a50f870a0a38]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMwJnuRL'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e87c0cf-d07a-41c5-be01-dca744d8c457]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f86ce-4760-48ee-b2a0-209fefafd261]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f38a7f-b09a-4d78-8032-8bb6f354b5fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]
Nov 29 23:09:28 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.
Nov 29 23:09:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e2576-ad66-4c9c-a0b8-23869fa9ae43]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf8dc2-a3a2-430b-9e4a-097eac2bb248]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:28 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:09:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:09:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cb4d5-1624-4fbe-9698-df531d1eede0]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:09:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:09:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23637343662373333', 'path': '/dev/sdf'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637343662373333', 'path': '/dev/sdf'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2123477696',display_name='tempest-TestShelveInstance-server-2123477696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2123477696',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL742LDaSYEIJTG907ugPcoBYVgqmhGoBMpBoZpcEMdn3/W8GzfjUv2h9hWAysqCjwIGr4cnPexh2SKIBfkgaxCwjzJggxvP5FLaGh/etBhuzzY4w3WIZCOCsin6CpECg==',key_name='tempest-TestShelveInstance-888719108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0258ba7ccde40a09e3e251fbef77431',ramdisk_id='',reservation_id='r-i514jhss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1542675207',owner_user_name='tempest-TestShelveInstance-1542675207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:19Z,user_data=None,user_id='476af5a1d41146788ce60db8a2683f23',uuid=089b181a-b746-4a25-94ad-50fd268a7cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converting VIF {"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.objects.instance [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'pci_devices' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:09:30 user nova-compute[75244]:   <uuid>089b181a-b746-4a25-94ad-50fd268a7cd9</uuid>
Nov 29 23:09:30 user nova-compute[75244]:   <name>instance-00000017</name>
Nov 29 23:09:30 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:09:30 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:09:30 user nova-compute[75244]:   <metadata>
Nov 29 23:09:30 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:09:30 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:09:30 user nova-compute[75244]:       <nova:name>tempest-TestShelveInstance-server-2123477696</nova:name>
Nov 29 23:09:30 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:09:28</nova:creationTime>
Nov 29 23:09:30 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:09:30 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:09:30 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:09:30 user nova-compute[75244]:       <nova:owner>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:user uuid="476af5a1d41146788ce60db8a2683f23">tempest-TestShelveInstance-1542675207-project-member</nova:user>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:project uuid="c0258ba7ccde40a09e3e251fbef77431">tempest-TestShelveInstance-1542675207</nova:project>
Nov 29 23:09:30 user nova-compute[75244]:       </nova:owner>
Nov 29 23:09:30 user nova-compute[75244]:       <nova:ports>
Nov 29 23:09:30 user nova-compute[75244]:         <nova:port uuid="cb3b5745-668b-43f3-a685-d55bbd873b3e">
Nov 29 23:09:30 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:09:30 user nova-compute[75244]:         </nova:port>
Nov 29 23:09:30 user nova-compute[75244]:       </nova:ports>
Nov 29 23:09:30 user nova-compute[75244]:     </nova:instance>
Nov 29 23:09:30 user nova-compute[75244]:   </metadata>
Nov 29 23:09:30 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:09:30 user nova-compute[75244]:     <system>
Nov 29 23:09:30 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:09:30 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:09:30 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:09:30 user nova-compute[75244]:       <entry name="serial">089b181a-b746-4a25-94ad-50fd268a7cd9</entry>
Nov 29 23:09:30 user nova-compute[75244]:       <entry name="uuid">089b181a-b746-4a25-94ad-50fd268a7cd9</entry>
Nov 29 23:09:30 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:09:30 user nova-compute[75244]:     </system>
Nov 29 23:09:30 user nova-compute[75244]:   </sysinfo>
Nov 29 23:09:30 user nova-compute[75244]:   <os>
Nov 29 23:09:30 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:09:30 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:09:30 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:09:30 user nova-compute[75244]:   </os>
Nov 29 23:09:30 user nova-compute[75244]:   <features>
Nov 29 23:09:30 user nova-compute[75244]:     <acpi/>
Nov 29 23:09:30 user nova-compute[75244]:     <apic/>
Nov 29 23:09:30 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:09:30 user nova-compute[75244]:   </features>
Nov 29 23:09:30 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:09:30 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:09:30 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:09:30 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:09:30 user nova-compute[75244]:   </clock>
Nov 29 23:09:30 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:09:30 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:09:30 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:09:30 user nova-compute[75244]:   </cpu>
Nov 29 23:09:30 user nova-compute[75244]:   <devices>
Nov 29 23:09:30 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:09:30 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:09:30 user nova-compute[75244]:       <source dev="/dev/sdf"/>
Nov 29 23:09:30 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:09:30 user nova-compute[75244]:       <serial>8cf0e830-0613-46a9-badd-bca0a18cd8af</serial>
Nov 29 23:09:30 user nova-compute[75244]:     </disk>
Nov 29 23:09:30 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:09:30 user nova-compute[75244]:       <mac address="fa:16:3e:23:77:dc"/>
Nov 29 23:09:30 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:30 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:09:30 user nova-compute[75244]:       <target dev="tapcb3b5745-66"/>
Nov 29 23:09:30 user nova-compute[75244]:     </interface>
Nov 29 23:09:30 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:09:30 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9/console.log" append="off"/>
Nov 29 23:09:30 user nova-compute[75244]:     </serial>
Nov 29 23:09:30 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:09:30 user nova-compute[75244]:     <video>
Nov 29 23:09:30 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:30 user nova-compute[75244]:     </video>
Nov 29 23:09:30 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:09:30 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:09:30 user nova-compute[75244]:     </rng>
Nov 29 23:09:30 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:09:30 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:09:30 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:09:30 user nova-compute[75244]:     </memballoon>
Nov 29 23:09:30 user nova-compute[75244]:   </devices>
Nov 29 23:09:30 user nova-compute[75244]: </domain>
Nov 29 23:09:30 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2123477696',display_name='tempest-TestShelveInstance-server-2123477696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2123477696',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL742LDaSYEIJTG907ugPcoBYVgqmhGoBMpBoZpcEMdn3/W8GzfjUv2h9hWAysqCjwIGr4cnPexh2SKIBfkgaxCwjzJggxvP5FLaGh/etBhuzzY4w3WIZCOCsin6CpECg==',key_name='tempest-TestShelveInstance-888719108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0258ba7ccde40a09e3e251fbef77431',ramdisk_id='',reservation_id='r-i514jhss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1542675207',owner_user_name='tempest-TestShelveInstance-1542675207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:19Z,user_data=None,user_id='476af5a1d41146788ce60db8a2683f23',uuid=089b181a-b746-4a25-94ad-50fd268a7cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converting VIF {"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG os_vif [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa953d62-c339-5449-99a4-aa35619cfd70', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb3b5745-66, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb3b5745-66, col_values=(('qos', UUID('c6e79dd3-3d1e-47bb-ace3-95a9af570271')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb3b5745-66, col_values=(('external_ids', {'iface-id': 'cb3b5745-668b-43f3-a685-d55bbd873b3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:77:dc', 'vm-uuid': '089b181a-b746-4a25-94ad-50fd268a7cd9'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:30 user nova-compute[75244]: INFO os_vif [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66')
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] No VIF found with MAC fa:16:3e:23:77:dc, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:09:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-08103bb5-9321-4cdf-b992-237698837b87 req-04541a52-29a7-4161-83bb-853ab63bf0a2 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08103bb5-9321-4cdf-b992-237698837b87 req-04541a52-29a7-4161-83bb-853ab63bf0a2 service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08103bb5-9321-4cdf-b992-237698837b87 req-04541a52-29a7-4161-83bb-853ab63bf0a2 service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08103bb5-9321-4cdf-b992-237698837b87 req-04541a52-29a7-4161-83bb-853ab63bf0a2 service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-08103bb5-9321-4cdf-b992-237698837b87 req-04541a52-29a7-4161-83bb-853ab63bf0a2 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:32 user nova-compute[75244]: WARNING nova.compute.manager [req-08103bb5-9321-4cdf-b992-237698837b87 req-04541a52-29a7-4161-83bb-853ab63bf0a2 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state building and task_state spawning.
Nov 29 23:09:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:09:33 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance spawned successfully.
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:09:33 user nova-compute[75244]: INFO nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:09:33 user nova-compute[75244]: INFO nova.compute.manager [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Took 15.56 seconds to build instance.
Nov 29 23:09:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12d4ee34-4f38-4936-a835-963a53965111 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.695s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating instance_info_cache with network_info: [{"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-b8ceea92-f765-46a7-8851-3bdacb386732" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:09:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-77d08442-2b67-443b-ba8a-f1b50ebf9113 req-f234757b-cc07-47fd-9051-5e051c323485 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-77d08442-2b67-443b-ba8a-f1b50ebf9113 req-f234757b-cc07-47fd-9051-5e051c323485 service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-77d08442-2b67-443b-ba8a-f1b50ebf9113 req-f234757b-cc07-47fd-9051-5e051c323485 service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-77d08442-2b67-443b-ba8a-f1b50ebf9113 req-f234757b-cc07-47fd-9051-5e051c323485 service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-77d08442-2b67-443b-ba8a-f1b50ebf9113 req-f234757b-cc07-47fd-9051-5e051c323485 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:34 user nova-compute[75244]: WARNING nova.compute.manager [req-77d08442-2b67-443b-ba8a-f1b50ebf9113 req-f234757b-cc07-47fd-9051-5e051c323485 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state None.
Nov 29 23:09:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:09:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-changed-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing instance network info cache due to event network-changed-d6b7adb2-824f-4381-82ad-8000e7bcc0d6. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] Acquiring lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] Acquired lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Refreshing network info cache for port d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:09:40 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:40 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=25.27664566040039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0e2feb16-677d-4713-8646-dbed4fe33e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b8ceea92-f765-46a7-8851-3bdacb386732 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f285c6d6-ccb5-419a-94df-0d608f08c33c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5eadf8f0-a801-47b5-99d8-34812a0d83db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 24054fdc-8f5e-4352-bdfa-717f288152bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 089b181a-b746-4a25-94ad-50fd268a7cd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updated VIF entry in instance network info cache for port d6b7adb2-824f-4381-82ad-8000e7bcc0d6. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:09:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [{"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-289feed1-0a63-4729-9660-da66010437d6 req-c349c152-618e-46b8-834d-0fb6a8143ae1 service nova] Releasing lock "refresh_cache-36433b7b-48ac-4d62-8c90-5c7bf8e70c89" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:42 user nova-compute[75244]: INFO nova.compute.manager [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Terminating instance
Nov 29 23:09:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-cb1946ac-b511-4cbb-abe2-f70ca9c7a691 req-0aeafdde-a016-426f-9b8d-2792ef694c54 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cb1946ac-b511-4cbb-abe2-f70ca9c7a691 req-0aeafdde-a016-426f-9b8d-2792ef694c54 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cb1946ac-b511-4cbb-abe2-f70ca9c7a691 req-0aeafdde-a016-426f-9b8d-2792ef694c54 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cb1946ac-b511-4cbb-abe2-f70ca9c7a691 req-0aeafdde-a016-426f-9b8d-2792ef694c54 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-cb1946ac-b511-4cbb-abe2-f70ca9c7a691 req-0aeafdde-a016-426f-9b8d-2792ef694c54 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-cb1946ac-b511-4cbb-abe2-f70ca9c7a691 req-0aeafdde-a016-426f-9b8d-2792ef694c54 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-5ea19d63-265a-4ead-b077-6ae5fae5a951 req-ed04f952-66b2-42f1-89ed-29191c7ef264 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5ea19d63-265a-4ead-b077-6ae5fae5a951 req-ed04f952-66b2-42f1-89ed-29191c7ef264 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5ea19d63-265a-4ead-b077-6ae5fae5a951 req-ed04f952-66b2-42f1-89ed-29191c7ef264 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5ea19d63-265a-4ead-b077-6ae5fae5a951 req-ed04f952-66b2-42f1-89ed-29191c7ef264 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-5ea19d63-265a-4ead-b077-6ae5fae5a951 req-ed04f952-66b2-42f1-89ed-29191c7ef264 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-5ea19d63-265a-4ead-b077-6ae5fae5a951 req-ed04f952-66b2-42f1-89ed-29191c7ef264 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-49fca043-bdd4-4f8f-9f3d-726404756b6d for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-d44eb36f-ece9-4406-898f-c537f929fad0 req-c4bb7be6-f387-47a9-b438-d2b77e0389bd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d44eb36f-ece9-4406-898f-c537f929fad0 req-c4bb7be6-f387-47a9-b438-d2b77e0389bd service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d44eb36f-ece9-4406-898f-c537f929fad0 req-c4bb7be6-f387-47a9-b438-d2b77e0389bd service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d44eb36f-ece9-4406-898f-c537f929fad0 req-c4bb7be6-f387-47a9-b438-d2b77e0389bd service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-d44eb36f-ece9-4406-898f-c537f929fad0 req-c4bb7be6-f387-47a9-b438-d2b77e0389bd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-d44eb36f-ece9-4406-898f-c537f929fad0 req-c4bb7be6-f387-47a9-b438-d2b77e0389bd service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-588b2724-774c-4898-888a-af320dd4d8a1 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:44 user nova-compute[75244]: INFO nova.compute.manager [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Detaching volume 6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:09:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:09:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Instance destroyed successfully.
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lazy-loading 'resources' on Instance uuid 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "address": "fa:16:3e:3d:40:46", "network": {"id": "14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-460678783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b7adb2-82", "ovs_interfaceid": "d6b7adb2-824f-4381-82ad-8000e7bcc0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6b7adb2-82, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: INFO nova.virt.block_device [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Attempting to driver detach volume 6858b275-9dd6-47b8-b60a-cdf1eae8281a from mountpoint /dev/vdb
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Attempting to detach device vdb from instance b8ceea92-f765-46a7-8851-3bdacb386732 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:09:44 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:09:44 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:09:44 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:09:44 user nova-compute[75244]:   <serial>6858b275-9dd6-47b8-b60a-cdf1eae8281a</serial>
Nov 29 23:09:44 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:09:44 user nova-compute[75244]: </disk>
Nov 29 23:09:44 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:09:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully detached device vdb from instance b8ceea92-f765-46a7-8851-3bdacb386732 from the persistent domain config.
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8ceea92-f765-46a7-8851-3bdacb386732 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:09:44 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:09:44 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:09:44 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:09:44 user nova-compute[75244]:   <serial>6858b275-9dd6-47b8-b60a-cdf1eae8281a</serial>
Nov 29 23:09:44 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:09:44 user nova-compute[75244]: </disk>
Nov 29 23:09:44 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=021c4605-d402-46a2-9948-e41a2fd939f1) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:40:46,bridge_name='br-int',has_traffic_filtering=True,id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6,network=Network(14dbd8aa-9a46-46d8-8741-a90ec4f9c4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b7adb2-82')
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap588b2724-77, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86903bfe-92d3-4bd1-9c13-8c0adb2ec91d) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:30:24,bridge_name='br-int',has_traffic_filtering=True,id=588b2724-774c-4898-888a-af320dd4d8a1,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap588b2724-77')
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49fca043-bd, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ff01f82-5a44-4b63-a029-ee7f805ea12d) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:76:4b,bridge_name='br-int',has_traffic_filtering=True,id=49fca043-bdd4-4f8f-9f3d-726404756b6d,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap49fca043-bd')
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93daea45-ed, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aee0f85-3361-4df4-b996-230a127357bd) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:71:cb,bridge_name='br-int',has_traffic_filtering=True,id=93daea45-ed35-4249-8c8a-0fda6a8f2ce7,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93daea45-ed')
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap071960bf-3c, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b300897b-1511-4092-833f-dd5ff4b7e9f7) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dd:69,bridge_name='br-int',has_traffic_filtering=True,id=071960bf-3ca4-4736-9646-8834f03c2200,network=Network(99e2f0a4-ff64-45b2-8975-dea4e7afd802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071960bf-3c')
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5517399b-85, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=126c04f0-fc0f-4c36-8aff-02391e3fbd10) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=5517399b-85e1-48f3-928d-049ee6f75695,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5517399b-85')
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T23:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1860282848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1860282848',id=18,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi/8QVqdSbtTMrygtKCVljMAoJFVYMiRVWwBMtUjJDJ1V820zskdt/AtmtiM665cLS5ZZwZhEcJBho9S6WcrJJOpnmr1yS0KS7eeeqPDZruIeidqaWyvlvNGGlulgou+A==',key_name='tempest-keypair-34601103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1036182cd9b4ce98f5c43b312c4ebe8',ramdisk_id='',reservation_id='r-oeo1zkau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-138562233',owner_user_name='tempest-TaggedBootDevicesTest-138562233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eba8741256384b64a7f789c9601a9ef8',uuid=36433b7b-48ac-4d62-8c90-5c7bf8e70c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converting VIF {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56fd4b0b-94, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3465611-90d5-499d-8af8-1ceb2e499dcc) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-56ebb2bc-d7ba-4cc8-9c0b-45fd8f32cd6c req-82c712ac-fde1-4ffe-b95a-410bdb163def service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-56ebb2bc-d7ba-4cc8-9c0b-45fd8f32cd6c req-82c712ac-fde1-4ffe-b95a-410bdb163def service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-56ebb2bc-d7ba-4cc8-9c0b-45fd8f32cd6c req-82c712ac-fde1-4ffe-b95a-410bdb163def service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-56ebb2bc-d7ba-4cc8-9c0b-45fd8f32cd6c req-82c712ac-fde1-4ffe-b95a-410bdb163def service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-56ebb2bc-d7ba-4cc8-9c0b-45fd8f32cd6c req-82c712ac-fde1-4ffe-b95a-410bdb163def service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-56ebb2bc-d7ba-4cc8-9c0b-45fd8f32cd6c req-82c712ac-fde1-4ffe-b95a-410bdb163def service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: INFO os_vif [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b8:79,bridge_name='br-int',has_traffic_filtering=True,id=56fd4b0b-94f0-4faa-a782-d75dffc72960,network=Network(645139a4-88fd-45f4-9859-25c8560beee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56fd4b0b-94')
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEMdJeFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b809f71-34d0-433f-a7c5-3b4a918dc140]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]: iSNS:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]: STATIC:
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: FIRMWARE:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:09:45 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:09:45 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e34e4-343c-4abf-bb23-ff2959f2537b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ad5ea-486a-4ca3-aec9-926ab6a92704]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c0f2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc59f07e-61e2-439d-b108-88ab3b9f0729]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36f605e-7cea-43d3-9383-a13a00ee13d8]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdef7cc-35c2-4293-9b56-a94b7fcce02f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-49fca043-bdd4-4f8f-9f3d-726404756b6d for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-5517399b-85e1-48f3-928d-049ee6f75695 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-5517399b-85e1-48f3-928d-049ee6f75695 for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-ffc87dcc-789c-46de-81dc-019366ccfcea req-cd0cb9f7-0779-49d6-b3a6-b7c4f2f38f93 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-56fd4b0b-94f0-4faa-a782-d75dffc72960 for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3fd984-600e-4597-ab71-6e6a3c50b7c2]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[68951a97-0cf4-4b99-a1ac-b2b865f4435a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d532b55-da35-43bb-ae3b-620bfc5d3b87]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260]
Nov 29 23:09:45 user nova-compute[75244]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0, portal: 172.16.0.220,3260] successful.
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-588b2724-774c-4898-888a-af320dd4d8a1 for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-unplugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-unplugged-071960bf-3ca4-4736-9646-8834f03c2200 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Acquiring lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] No waiting events found dispatching network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING nova.compute.manager [req-fb4c58c8-bbcf-464f-b030-16c66c8231cd req-7db9c85a-1634-4ec4-965e-ade10ac07cf7 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received unexpected event network-vif-plugged-071960bf-3ca4-4736-9646-8834f03c2200 for instance with vm_state active and task_state deleting.
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93a5a6-4148-4752-989d-7d4909a3c7f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec309a00-81c6-45f9-a2be-e5b66fb9b4c1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== disconnect_volume: return (393ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZDfQyXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37835ad3-6fbc-4b4c-b1c6-b53ffc44a292]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]: iSNS:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]: STATIC:
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: FIRMWARE:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:09:45 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:09:45 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc023d35-e003-44dc-9672-c69b6e65887d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d5a87d-ea41-4ec7-bda0-54237c9669bc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d2613-e94c-45dc-8c35-74bbcb7fca97]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dcbcc7-75ed-4b43-97c3-8e92996469d8]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5f105-1f4e-4dd1-bb99-8e6b4d73075a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b343b06e-ddf1-4b16-b975-d7fd0cdd798a]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f408802-777f-4914-8b4b-4a2097102b17]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7baf44-af54-47e9-9c17-27313741db70]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260]
Nov 29 23:09:45 user nova-compute[75244]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680, portal: 172.16.0.220,3260] successful.
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5913f69e-ace9-49dd-815c-816d8cc08680 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3322e3c6-7b58-4113-9e0b-504336063aa6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== disconnect_volume: return (328ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvYjVRHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:09:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15d125-9f59-4fb7-8765-392912520a79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]: iSNS:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]: STATIC:
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:09:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:09:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:09:45 user nova-compute[75244]: FIRMWARE:
Nov 29 23:09:45 user nova-compute[75244]: No targets found.
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:09:45 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:09:45 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7337556-fc98-489a-9ec7-c44c543ea20f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1efe4-dd5a-422f-a5e4-4c432eeab3c1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:09:45 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:09:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609'): ({'sdg'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Removing single pathed devices sdg {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ebdc9c-c4e7-40ee-801b-809be778f65a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[511638b7-dcf6-4823-a2d8-d4c1395c3e74]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Flushing IO for device /dev/sdg {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae37271-f2e9-4cbd-a8d3-c4355d7c992a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:09:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55f6dc-14b7-48e9-9694-88ec8b54bef4]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] SCSI volumes sdg have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bad75e-1633-487f-95e7-45030d36f799]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e39d18-c803-4806-a1bf-1d0ea93c6790]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260]
Nov 29 23:09:46 user nova-compute[75244]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609, portal: 172.16.0.220,3260] successful.
Nov 29 23:09:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab334918-77ea-40b3-b53f-88949249a609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[93611107-6237-4200-aa41-4c6c4960d477]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] <== disconnect_volume: return (312ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:09:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Deleting instance files /opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89_del
Nov 29 23:09:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Deletion of /opt/stack/data/nova/instances/36433b7b-48ac-4d62-8c90-5c7bf8e70c89_del complete
Nov 29 23:09:46 user nova-compute[75244]: INFO nova.compute.manager [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Took 3.62 seconds to destroy the instance on the hypervisor.
Nov 29 23:09:46 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:09:46 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:09:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-554f774a-1827-4275-9883-edeff3b6d4e2 req-dcb08c25-dfb4-4864-a721-0b6546bd9696 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-deleted-d6b7adb2-824f-4381-82ad-8000e7bcc0d6 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:47 user nova-compute[75244]: INFO nova.compute.manager [req-554f774a-1827-4275-9883-edeff3b6d4e2 req-dcb08c25-dfb4-4864-a721-0b6546bd9696 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Neutron deleted interface d6b7adb2-824f-4381-82ad-8000e7bcc0d6; detaching it from the instance and deleting it from the info cache
Nov 29 23:09:47 user nova-compute[75244]: DEBUG nova.network.neutron [req-554f774a-1827-4275-9883-edeff3b6d4e2 req-dcb08c25-dfb4-4864-a721-0b6546bd9696 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [{"id": "588b2724-774c-4898-888a-af320dd4d8a1", "address": "fa:16:3e:97:30:24", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588b2724-77", "ovs_interfaceid": "588b2724-774c-4898-888a-af320dd4d8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "address": "fa:16:3e:a9:76:4b", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49fca043-bd", "ovs_interfaceid": "49fca043-bdd4-4f8f-9f3d-726404756b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "address": "fa:16:3e:1d:71:cb", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93daea45-ed", "ovs_interfaceid": "93daea45-ed35-4249-8c8a-0fda6a8f2ce7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "071960bf-3ca4-4736-9646-8834f03c2200", "address": "fa:16:3e:6a:dd:69", "network": {"id": "99e2f0a4-ff64-45b2-8975-dea4e7afd802", "bridge": "br-int", "label": "tempest-device-tagging-net1-1491711742", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071960bf-3c", "ovs_interfaceid": "071960bf-3ca4-4736-9646-8834f03c2200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5517399b-85e1-48f3-928d-049ee6f75695", "address": "fa:16:3e:d8:bf:bd", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5517399b-85", "ovs_interfaceid": "5517399b-85e1-48f3-928d-049ee6f75695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "address": "fa:16:3e:91:b8:79", "network": {"id": "645139a4-88fd-45f4-9859-25c8560beee7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1903317976", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1036182cd9b4ce98f5c43b312c4ebe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56fd4b0b-94", "ovs_interfaceid": "56fd4b0b-94f0-4faa-a782-d75dffc72960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-554f774a-1827-4275-9883-edeff3b6d4e2 req-dcb08c25-dfb4-4864-a721-0b6546bd9696 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Detach interface failed, port_id=d6b7adb2-824f-4381-82ad-8000e7bcc0d6, reason: Instance 36433b7b-48ac-4d62-8c90-5c7bf8e70c89 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:09:49 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:49 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Took 2.91 seconds to deallocate network for instance.
Nov 29 23:09:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-cbf42c26-03bd-4d49-a16c-99dbf75a6cf4 req-488de459-297c-41c0-b9d5-463238b69739 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-deleted-56fd4b0b-94f0-4faa-a782-d75dffc72960 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-cbf42c26-03bd-4d49-a16c-99dbf75a6cf4 req-488de459-297c-41c0-b9d5-463238b69739 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-deleted-5517399b-85e1-48f3-928d-049ee6f75695 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-cbf42c26-03bd-4d49-a16c-99dbf75a6cf4 req-488de459-297c-41c0-b9d5-463238b69739 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-deleted-93daea45-ed35-4249-8c8a-0fda6a8f2ce7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-cbf42c26-03bd-4d49-a16c-99dbf75a6cf4 req-488de459-297c-41c0-b9d5-463238b69739 service nova] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Received event network-vif-deleted-071960bf-3ca4-4736-9646-8834f03c2200 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:52 user nova-compute[75244]: INFO nova.compute.manager [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] [instance: 36433b7b-48ac-4d62-8c90-5c7bf8e70c89] Took 2.94 seconds to detach 3 volumes for instance.
Nov 29 23:09:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:52 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:52 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:52 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Deleted allocations for instance 36433b7b-48ac-4d62-8c90-5c7bf8e70c89
Nov 29 23:09:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b742dfb6-4249-4c4a-8940-d179d9e0cc1c tempest-TaggedBootDevicesTest-138562233 tempest-TaggedBootDevicesTest-138562233-project-member] Lock "36433b7b-48ac-4d62-8c90-5c7bf8e70c89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.945s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquired lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'info_cache' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Releasing lock "refresh_cache-019c268b-dc0f-4e68-95e2-f26f5c24463b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance destroyed successfully.
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'resources' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG os_vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69add1a4-a1, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=403352b5-68cc-474a-8edd-9c1b26c16ebd) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:54 user nova-compute[75244]: INFO os_vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1')
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start _get_guest_xml network_info=[{"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'numa_topology' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:54 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:54 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'vcpu_model' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'pci_devices' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:09:54 user nova-compute[75244]:   <uuid>019c268b-dc0f-4e68-95e2-f26f5c24463b</uuid>
Nov 29 23:09:54 user nova-compute[75244]:   <name>instance-00000003</name>
Nov 29 23:09:54 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:09:54 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:09:54 user nova-compute[75244]:   <metadata>
Nov 29 23:09:54 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:09:54 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:09:54 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeTestJSON-server-2138708551</nova:name>
Nov 29 23:09:54 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:09:54</nova:creationTime>
Nov 29 23:09:54 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:09:54 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:09:54 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:09:54 user nova-compute[75244]:       <nova:owner>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:user uuid="aab2f432fdbf48d3bc546158221a1448">tempest-AttachVolumeTestJSON-2123642001-project-member</nova:user>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:project uuid="8b3fc795bdd143a9bbb8b3d5a040e92f">tempest-AttachVolumeTestJSON-2123642001</nova:project>
Nov 29 23:09:54 user nova-compute[75244]:       </nova:owner>
Nov 29 23:09:54 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:09:54 user nova-compute[75244]:       <nova:ports>
Nov 29 23:09:54 user nova-compute[75244]:         <nova:port uuid="69add1a4-a188-4454-9331-c39bffcd8b49">
Nov 29 23:09:54 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:09:54 user nova-compute[75244]:         </nova:port>
Nov 29 23:09:54 user nova-compute[75244]:       </nova:ports>
Nov 29 23:09:54 user nova-compute[75244]:     </nova:instance>
Nov 29 23:09:54 user nova-compute[75244]:   </metadata>
Nov 29 23:09:54 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:09:54 user nova-compute[75244]:     <system>
Nov 29 23:09:54 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:09:54 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:09:54 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:09:54 user nova-compute[75244]:       <entry name="serial">019c268b-dc0f-4e68-95e2-f26f5c24463b</entry>
Nov 29 23:09:54 user nova-compute[75244]:       <entry name="uuid">019c268b-dc0f-4e68-95e2-f26f5c24463b</entry>
Nov 29 23:09:54 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:09:54 user nova-compute[75244]:     </system>
Nov 29 23:09:54 user nova-compute[75244]:   </sysinfo>
Nov 29 23:09:54 user nova-compute[75244]:   <os>
Nov 29 23:09:54 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:09:54 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:09:54 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:09:54 user nova-compute[75244]:   </os>
Nov 29 23:09:54 user nova-compute[75244]:   <features>
Nov 29 23:09:54 user nova-compute[75244]:     <acpi/>
Nov 29 23:09:54 user nova-compute[75244]:     <apic/>
Nov 29 23:09:54 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:09:54 user nova-compute[75244]:   </features>
Nov 29 23:09:54 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:09:54 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:09:54 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:09:54 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:09:54 user nova-compute[75244]:   </clock>
Nov 29 23:09:54 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:09:54 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:09:54 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:09:54 user nova-compute[75244]:   </cpu>
Nov 29 23:09:54 user nova-compute[75244]:   <devices>
Nov 29 23:09:54 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:09:54 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:09:54 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk"/>
Nov 29 23:09:54 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:09:54 user nova-compute[75244]:     </disk>
Nov 29 23:09:54 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:09:54 user nova-compute[75244]:       <mac address="fa:16:3e:96:27:05"/>
Nov 29 23:09:54 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:54 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:09:54 user nova-compute[75244]:       <target dev="tap69add1a4-a1"/>
Nov 29 23:09:54 user nova-compute[75244]:     </interface>
Nov 29 23:09:54 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:09:54 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/console.log" append="off"/>
Nov 29 23:09:54 user nova-compute[75244]:     </serial>
Nov 29 23:09:54 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:09:54 user nova-compute[75244]:     <video>
Nov 29 23:09:54 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:09:54 user nova-compute[75244]:     </video>
Nov 29 23:09:54 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:09:54 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:09:54 user nova-compute[75244]:     </rng>
Nov 29 23:09:54 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:09:54 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:09:54 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:09:54 user nova-compute[75244]:     </memballoon>
Nov 29 23:09:54 user nova-compute[75244]:   </devices>
Nov 29 23:09:54 user nova-compute[75244]: </domain>
Nov 29 23:09:54 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:09:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'trusted_certs' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:09:55 user nova-compute[75244]: INFO nova.compute.claims [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Claim successful on node user
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Cannot resize image /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'migration_context' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.objects.base [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Object Instance<019c268b-dc0f-4e68-95e2-f26f5c24463b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG os_vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a264fd11-71ca-5439-a669-6157452ef944', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69add1a4-a1, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69add1a4-a1, col_values=(('qos', UUID('75dd7d98-739c-441a-9f21-56b67cc75915')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69add1a4-a1, col_values=(('external_ids', {'iface-id': '69add1a4-a188-4454-9331-c39bffcd8b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:27:05', 'vm-uuid': '019c268b-dc0f-4e68-95e2-f26f5c24463b'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:55 user nova-compute[75244]: INFO os_vif [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1')
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:09:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:09:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:09:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:09:56 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:09:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:09:56 user nova-compute[75244]: DEBUG nova.policy [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2a16d9d8a414de4b6621acd12b89aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9595b50731fc44ae85e99ded8dbbaf61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:09:56 user nova-compute[75244]: INFO nova.virt.block_device [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Booting with blank volume at /dev/vda
Nov 29 23:09:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Successfully created port: 6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-1da1d129-4a8c-43f9-ad72-cf1ba81c23b3 req-262570eb-5799-4a32-a938-a000847c505f service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1da1d129-4a8c-43f9-ad72-cf1ba81c23b3 req-262570eb-5799-4a32-a938-a000847c505f service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1da1d129-4a8c-43f9-ad72-cf1ba81c23b3 req-262570eb-5799-4a32-a938-a000847c505f service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1da1d129-4a8c-43f9-ad72-cf1ba81c23b3 req-262570eb-5799-4a32-a938-a000847c505f service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-1da1d129-4a8c-43f9-ad72-cf1ba81c23b3 req-262570eb-5799-4a32-a938-a000847c505f service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:57 user nova-compute[75244]: WARNING nova.compute.manager [req-1da1d129-4a8c-43f9-ad72-cf1ba81c23b3 req-262570eb-5799-4a32-a938-a000847c505f service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state stopped and task_state powering-on.
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Successfully updated port: 6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-changed-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Refreshing instance network info cache due to event network-changed-6c2ef10b-af71-418d-854e-fa6ddf06ecf2. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] Acquiring lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance network_info: |[{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] Acquired lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Refreshing network info cache for port 6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updated VIF entry in instance network info cache for port 6c2ef10b-af71-418d-854e-fa6ddf06ecf2. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:09:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f4627550-aeb9-4939-99f1-800c8517911a req-650b3fad-77de-42b4-ba27-95eff07e5199 service nova] Releasing lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:09:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:09:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance rebooted successfully.
Nov 29 23:09:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2a692482-beba-467a-b5c7-bfa449cf9e5f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:09:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-68ecd520-d6d4-44d8-acbe-595ce6263816 req-938b5366-eb8b-4b89-98fa-a2bfdde30d90 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:09:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68ecd520-d6d4-44d8-acbe-595ce6263816 req-938b5366-eb8b-4b89-98fa-a2bfdde30d90 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:09:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68ecd520-d6d4-44d8-acbe-595ce6263816 req-938b5366-eb8b-4b89-98fa-a2bfdde30d90 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:09:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68ecd520-d6d4-44d8-acbe-595ce6263816 req-938b5366-eb8b-4b89-98fa-a2bfdde30d90 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:09:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-68ecd520-d6d4-44d8-acbe-595ce6263816 req-938b5366-eb8b-4b89-98fa-a2bfdde30d90 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:09:59 user nova-compute[75244]: WARNING nova.compute.manager [req-68ecd520-d6d4-44d8-acbe-595ce6263816 req-938b5366-eb8b-4b89-98fa-a2bfdde30d90 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state active and task_state None.
Nov 29 23:10:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG os_brick.utils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[201579b4-b3e5-41cc-9f58-8edd0118d9d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9887901-f1f9-4e89-b8e2-74082ea74675]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6841b97-3257-4175-97a6-c548fa48f792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d3fcf4-e825-4fc3-ac8b-da05666839fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:10:01 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:10:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab773f7-fa85-4a64-b2d3-3ee1dd38dbc1]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG os_brick.utils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:10:01 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating existing volume attachment record: 1a739e31-fa0c-454a-b8b0-93235fa3cdf5 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:10:04 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8ceea92-f765-46a7-8851-3bdacb386732 is timed out.
Nov 29 23:10:04 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully detached device vdb from instance b8ceea92-f765-46a7-8851-3bdacb386732 from the live domain config.
Nov 29 23:10:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOGdCtYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:10:04 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:10:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8104fd9b-8d21-45d4-bf4c-0e98eb130165]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:10:04 user nova-compute[75244]: No targets found.
Nov 29 23:10:04 user nova-compute[75244]: iSNS:
Nov 29 23:10:04 user nova-compute[75244]: No targets found.
Nov 29 23:10:04 user nova-compute[75244]: STATIC:
Nov 29 23:10:04 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:10:04 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:10:04 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:10:04 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:10:04 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:10:04 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:10:04 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a
Nov 29 23:10:04 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:10:04 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:10:04 user nova-compute[75244]: FIRMWARE:
Nov 29 23:10:04 user nova-compute[75244]: No targets found.
Nov 29 23:10:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:10:04 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:10:04 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:10:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2a50f-e7a5-4057-bb12-12413f74ad62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fae9f-7bd0-4576-a73a-dc96fe53f051]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:10:05 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:05 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a (non-flash)
Nov 29 23:10:05 user nova-compute[75244]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:05 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80438e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1072a0-8ba8-41fe-985e-3abc3fbd9320]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30a0852-dae9-4584-b9cb-5726822c5e01]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[518ccf18-d161-4c81-b514-1bfdca921b04]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad647ac-a18d-417c-87c4-f58e33e5988e]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f84174-1ad5-4936-9e6a-bb5f11d07cc5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[782116c3-6ba8-4126-aa2a-d7ba72a31cbc]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260]
Nov 29 23:10:05 user nova-compute[75244]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a, portal: 172.16.0.220,3260] successful.
Nov 29 23:10:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6858b275-9dd6-47b8-b60a-cdf1eae8281a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ef4749-5de4-4e51-9f61-50051b6235ac]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== disconnect_volume: return (292ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd5f5622-aa1e-4a93-af7c-d13a7a684e32 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.031s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:10:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Creating image(s)
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Ensure instance console log exists: /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Start _get_guest_xml network_info=[{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9cb9953c-e973-45b7-87d4-00a4f3e74a54', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa592369-87e1-4208-a285-00a92bcd9d0b', 'serial': 'aa592369-87e1-4208-a285-00a92bcd9d0b'}, 'attachment_id': '1a739e31-fa0c-454a-b8b0-93235fa3cdf5', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:10:10 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:10:10 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:10:10 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:10:10 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:10:10 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c056ead2-5fbc-4d81-a44d-f47953ab99d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:10:10 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcfd1e1-2fc1-4593-aa77-fb5aed20e165]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b] added
Nov 29 23:10:10 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e30de37-a5d4-4e20-860f-ebf789017290]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc891a9f-20d4-41ab-b9ae-ef33c0cfda70]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUlVfgDW {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUlVfgDW" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fab656-2d0a-40aa-a25e-0e2c3bdffe63]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FUlVfgDW'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4241c16a-f4f3-47bc-98f1-1f4b8514a3ea]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f8028-1ce8-4917-8563-fa4e4f503175]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:10 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:10 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:10 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:10 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9845637-fcc8-4ae0-a951-f13b5bff8276]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260]
Nov 29 23:10:10 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260] successful.
Nov 29 23:10:10 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff91dd9-3c58-40e6-a778-668170916980]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e4edd3-1b9f-4289-85af-d2569cb2a090]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:11 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:11 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:10:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:11 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:11 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:10:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1da43-8f84-490e-a298-5dcd33532742]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:10:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23539336564636237', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539336564636237', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191563974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191563974',id=24,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-65mt2o0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:56Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=9cb9953c-e973-45b7-87d4-00a4f3e74a54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:10:12 user nova-compute[75244]:   <uuid>9cb9953c-e973-45b7-87d4-00a4f3e74a54</uuid>
Nov 29 23:10:12 user nova-compute[75244]:   <name>instance-00000018</name>
Nov 29 23:10:12 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:10:12 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:10:12 user nova-compute[75244]:   <metadata>
Nov 29 23:10:12 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:10:12 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:10:12 user nova-compute[75244]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-191563974</nova:name>
Nov 29 23:10:12 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:10:10</nova:creationTime>
Nov 29 23:10:12 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:10:12 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:10:12 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:10:12 user nova-compute[75244]:       <nova:owner>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:user uuid="c2a16d9d8a414de4b6621acd12b89aa0">tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member</nova:user>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:project uuid="9595b50731fc44ae85e99ded8dbbaf61">tempest-ServerBootFromVolumeStableRescueTest-1262475948</nova:project>
Nov 29 23:10:12 user nova-compute[75244]:       </nova:owner>
Nov 29 23:10:12 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:10:12 user nova-compute[75244]:       <nova:ports>
Nov 29 23:10:12 user nova-compute[75244]:         <nova:port uuid="6c2ef10b-af71-418d-854e-fa6ddf06ecf2">
Nov 29 23:10:12 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 23:10:12 user nova-compute[75244]:         </nova:port>
Nov 29 23:10:12 user nova-compute[75244]:       </nova:ports>
Nov 29 23:10:12 user nova-compute[75244]:     </nova:instance>
Nov 29 23:10:12 user nova-compute[75244]:   </metadata>
Nov 29 23:10:12 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:10:12 user nova-compute[75244]:     <system>
Nov 29 23:10:12 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:10:12 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:10:12 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:10:12 user nova-compute[75244]:       <entry name="serial">9cb9953c-e973-45b7-87d4-00a4f3e74a54</entry>
Nov 29 23:10:12 user nova-compute[75244]:       <entry name="uuid">9cb9953c-e973-45b7-87d4-00a4f3e74a54</entry>
Nov 29 23:10:12 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:10:12 user nova-compute[75244]:     </system>
Nov 29 23:10:12 user nova-compute[75244]:   </sysinfo>
Nov 29 23:10:12 user nova-compute[75244]:   <os>
Nov 29 23:10:12 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:10:12 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:10:12 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:10:12 user nova-compute[75244]:   </os>
Nov 29 23:10:12 user nova-compute[75244]:   <features>
Nov 29 23:10:12 user nova-compute[75244]:     <acpi/>
Nov 29 23:10:12 user nova-compute[75244]:     <apic/>
Nov 29 23:10:12 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:10:12 user nova-compute[75244]:   </features>
Nov 29 23:10:12 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:10:12 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:10:12 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:10:12 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:10:12 user nova-compute[75244]:   </clock>
Nov 29 23:10:12 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:10:12 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:10:12 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:10:12 user nova-compute[75244]:   </cpu>
Nov 29 23:10:12 user nova-compute[75244]:   <devices>
Nov 29 23:10:12 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:10:12 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:10:12 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:10:12 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:10:12 user nova-compute[75244]:       <serial>aa592369-87e1-4208-a285-00a92bcd9d0b</serial>
Nov 29 23:10:12 user nova-compute[75244]:     </disk>
Nov 29 23:10:12 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:10:12 user nova-compute[75244]:       <mac address="fa:16:3e:47:3f:68"/>
Nov 29 23:10:12 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:10:12 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:10:12 user nova-compute[75244]:       <target dev="tap6c2ef10b-af"/>
Nov 29 23:10:12 user nova-compute[75244]:     </interface>
Nov 29 23:10:12 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:10:12 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/console.log" append="off"/>
Nov 29 23:10:12 user nova-compute[75244]:     </serial>
Nov 29 23:10:12 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:10:12 user nova-compute[75244]:     <video>
Nov 29 23:10:12 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:10:12 user nova-compute[75244]:     </video>
Nov 29 23:10:12 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:10:12 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:10:12 user nova-compute[75244]:     </rng>
Nov 29 23:10:12 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:10:12 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:10:12 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:10:12 user nova-compute[75244]:     </memballoon>
Nov 29 23:10:12 user nova-compute[75244]:   </devices>
Nov 29 23:10:12 user nova-compute[75244]: </domain>
Nov 29 23:10:12 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191563974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191563974',id=24,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-65mt2o0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:09:56Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=9cb9953c-e973-45b7-87d4-00a4f3e74a54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG os_vif [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1993aa6e-356d-5c60-8296-7954bd284490', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c2ef10b-af, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c2ef10b-af, col_values=(('qos', UUID('2b25cb77-74b5-411d-a06c-364cae82730b')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c2ef10b-af, col_values=(('external_ids', {'iface-id': '6c2ef10b-af71-418d-854e-fa6ddf06ecf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:3f:68', 'vm-uuid': '9cb9953c-e973-45b7-87d4-00a4f3e74a54'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:12 user nova-compute[75244]: INFO os_vif [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af')
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:10:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No VIF found with MAC fa:16:3e:47:3f:68, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-a4155097-8e79-4187-9075-5f9736e018e2 req-b181eb43-6171-47cf-bcb1-216b659db1c6 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a4155097-8e79-4187-9075-5f9736e018e2 req-b181eb43-6171-47cf-bcb1-216b659db1c6 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a4155097-8e79-4187-9075-5f9736e018e2 req-b181eb43-6171-47cf-bcb1-216b659db1c6 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a4155097-8e79-4187-9075-5f9736e018e2 req-b181eb43-6171-47cf-bcb1-216b659db1c6 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-a4155097-8e79-4187-9075-5f9736e018e2 req-b181eb43-6171-47cf-bcb1-216b659db1c6 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:13 user nova-compute[75244]: WARNING nova.compute.manager [req-a4155097-8e79-4187-9075-5f9736e018e2 req-b181eb43-6171-47cf-bcb1-216b659db1c6 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state building and task_state spawning.
Nov 29 23:10:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:10:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance spawned successfully.
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:10:15 user nova-compute[75244]: INFO nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:10:15 user nova-compute[75244]: INFO nova.compute.manager [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Took 20.16 seconds to build instance.
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-e284d150-3789-463b-a120-692a5e53bf09 req-d37cc5b5-785c-4922-a6d6-813958da9a24 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e284d150-3789-463b-a120-692a5e53bf09 req-d37cc5b5-785c-4922-a6d6-813958da9a24 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e284d150-3789-463b-a120-692a5e53bf09 req-d37cc5b5-785c-4922-a6d6-813958da9a24 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e284d150-3789-463b-a120-692a5e53bf09 req-d37cc5b5-785c-4922-a6d6-813958da9a24 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-e284d150-3789-463b-a120-692a5e53bf09 req-d37cc5b5-785c-4922-a6d6-813958da9a24 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:15 user nova-compute[75244]: WARNING nova.compute.manager [req-e284d150-3789-463b-a120-692a5e53bf09 req-d37cc5b5-785c-4922-a6d6-813958da9a24 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state active and task_state None.
Nov 29 23:10:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7d200a4c-c6f8-481d-9bac-bf4a7eefba73 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.293s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:26 user nova-compute[75244]: INFO nova.compute.manager [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Terminating instance
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-c431fcae-8eb4-4f01-b9d8-f0daa6dced45 req-1f50e6ea-98c9-48ad-bdd6-5712a54360b9 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-vif-unplugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c431fcae-8eb4-4f01-b9d8-f0daa6dced45 req-1f50e6ea-98c9-48ad-bdd6-5712a54360b9 service nova] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c431fcae-8eb4-4f01-b9d8-f0daa6dced45 req-1f50e6ea-98c9-48ad-bdd6-5712a54360b9 service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c431fcae-8eb4-4f01-b9d8-f0daa6dced45 req-1f50e6ea-98c9-48ad-bdd6-5712a54360b9 service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-c431fcae-8eb4-4f01-b9d8-f0daa6dced45 req-1f50e6ea-98c9-48ad-bdd6-5712a54360b9 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] No waiting events found dispatching network-vif-unplugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-c431fcae-8eb4-4f01-b9d8-f0daa6dced45 req-1f50e6ea-98c9-48ad-bdd6-5712a54360b9 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-vif-unplugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:10:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Instance destroyed successfully.
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lazy-loading 'resources' on Instance uuid 0e2feb16-677d-4713-8646-dbed4fe33e59 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2095721698',display_name='tempest-ServersNegativeTestJSON-server-2095721698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2095721698',id=2,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15889b42830c48049aa8537bd8e82d56',ramdisk_id='',reservation_id='r-0f0cv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1248877561',owner_user_name='tempest-ServersNegativeTestJSON-1248877561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:01:47Z,user_data=None,user_id='7f680496b0c147a48948cb1f24c65797',uuid=0e2feb16-677d-4713-8646-dbed4fe33e59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converting VIF {"id": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "address": "fa:16:3e:ec:11:7e", "network": {"id": "1cb19822-c84c-4d19-a9c4-c5531d3a7478", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1205372035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15889b42830c48049aa8537bd8e82d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap856339eb-f4", "ovs_interfaceid": "856339eb-f4d3-4fce-abe7-bb017fcccbf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG os_vif [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap856339eb-f4, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=871d7914-e453-4a49-9ba1-3457568be4c6) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:26 user nova-compute[75244]: INFO os_vif [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=856339eb-f4d3-4fce-abe7-bb017fcccbf7,network=Network(1cb19822-c84c-4d19-a9c4-c5531d3a7478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap856339eb-f4')
Nov 29 23:10:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Deleting instance files /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59_del
Nov 29 23:10:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Deletion of /opt/stack/data/nova/instances/0e2feb16-677d-4713-8646-dbed4fe33e59_del complete
Nov 29 23:10:26 user nova-compute[75244]: INFO nova.compute.manager [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 29 23:10:26 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:10:26 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:10:27 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:10:27 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Took 0.49 seconds to deallocate network for instance.
Nov 29 23:10:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:27 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:10:27 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:10:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:27 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Deleted allocations for instance 0e2feb16-677d-4713-8646-dbed4fe33e59
Nov 29 23:10:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a5bd7062-7e46-4062-8255-251831f47693 tempest-ServersNegativeTestJSON-1248877561 tempest-ServersNegativeTestJSON-1248877561-project-member] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] Acquiring lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] Lock "0e2feb16-677d-4713-8646-dbed4fe33e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] No waiting events found dispatching network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:28 user nova-compute[75244]: WARNING nova.compute.manager [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received unexpected event network-vif-plugged-856339eb-f4d3-4fce-abe7-bb017fcccbf7 for instance with vm_state deleted and task_state None.
Nov 29 23:10:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b0d0b03f-ce59-48f0-a660-100582a17818 req-665b0cc9-46b9-41e2-a2fe-a474ee9b6126 service nova] [instance: 0e2feb16-677d-4713-8646-dbed4fe33e59] Received event network-vif-deleted-856339eb-f4d3-4fce-abe7-bb017fcccbf7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating instance_info_cache with network_info: [{"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-f285c6d6-ccb5-419a-94df-0d608f08c33c" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:10:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:34 user nova-compute[75244]: INFO nova.compute.manager [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Terminating instance
Nov 29 23:10:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-9032f648-1423-4f74-9757-24434df19a3a req-9e98807b-4d5e-4acb-815c-88ecebcaecd6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-vif-unplugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9032f648-1423-4f74-9757-24434df19a3a req-9e98807b-4d5e-4acb-815c-88ecebcaecd6 service nova] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9032f648-1423-4f74-9757-24434df19a3a req-9e98807b-4d5e-4acb-815c-88ecebcaecd6 service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9032f648-1423-4f74-9757-24434df19a3a req-9e98807b-4d5e-4acb-815c-88ecebcaecd6 service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-9032f648-1423-4f74-9757-24434df19a3a req-9e98807b-4d5e-4acb-815c-88ecebcaecd6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] No waiting events found dispatching network-vif-unplugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-9032f648-1423-4f74-9757-24434df19a3a req-9e98807b-4d5e-4acb-815c-88ecebcaecd6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-vif-unplugged-39466e90-10cb-4540-bd33-8ef69252ced7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Instance destroyed successfully.
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.objects.instance [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'resources' on Instance uuid b8ceea92-f765-46a7-8851-3bdacb386732 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-923946142',display_name='tempest-AttachVolumeNegativeTest-server-923946142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-923946142',id=14,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI0lmtRFkyeAI/gt1RmsEp9wYbuwZnAR1XBqpvtkhLgJcyhgm9isfxnIsx10vOlSO8rbApqR1gAsUgTUINyEFg84wWaEc/aRTjrFbKgU472DWPHps4gHQC16sKnfnEGxQ==',key_name='tempest-keypair-1382844026',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-65inmqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=b8ceea92-f765-46a7-8851-3bdacb386732,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "39466e90-10cb-4540-bd33-8ef69252ced7", "address": "fa:16:3e:e8:44:ef", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39466e90-10", "ovs_interfaceid": "39466e90-10cb-4540-bd33-8ef69252ced7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG os_vif [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39466e90-10, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a10c0a0b-83ab-4ef9-8c7c-f8d9856cc8cd) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:35 user nova-compute[75244]: INFO os_vif [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:44:ef,bridge_name='br-int',has_traffic_filtering=True,id=39466e90-10cb-4540-bd33-8ef69252ced7,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39466e90-10')
Nov 29 23:10:35 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Deleting instance files /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732_del
Nov 29 23:10:35 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Deletion of /opt/stack/data/nova/instances/b8ceea92-f765-46a7-8851-3bdacb386732_del complete
Nov 29 23:10:35 user nova-compute[75244]: INFO nova.compute.manager [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 23:10:35 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:10:35 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:10:36 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Took 1.02 seconds to deallocate network for instance.
Nov 29 23:10:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-13617d28-70e7-45dc-895b-c2c28253d1f7 req-50915e62-4399-4ef6-b0ea-624f88e55ff6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-vif-deleted-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:36 user nova-compute[75244]: INFO nova.compute.manager [req-13617d28-70e7-45dc-895b-c2c28253d1f7 req-50915e62-4399-4ef6-b0ea-624f88e55ff6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Neutron deleted interface 39466e90-10cb-4540-bd33-8ef69252ced7; detaching it from the instance and deleting it from the info cache
Nov 29 23:10:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-13617d28-70e7-45dc-895b-c2c28253d1f7 req-50915e62-4399-4ef6-b0ea-624f88e55ff6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-13617d28-70e7-45dc-895b-c2c28253d1f7 req-50915e62-4399-4ef6-b0ea-624f88e55ff6 service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Detach interface failed, port_id=39466e90-10cb-4540-bd33-8ef69252ced7, reason: Instance b8ceea92-f765-46a7-8851-3bdacb386732 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:10:36 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:10:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:37 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Deleted allocations for instance b8ceea92-f765-46a7-8851-3bdacb386732
Nov 29 23:10:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-58f23808-e841-4ccb-9047-5024375be5e3 req-f35c626a-633d-428d-b86c-9518e069144c service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received event network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-58f23808-e841-4ccb-9047-5024375be5e3 req-f35c626a-633d-428d-b86c-9518e069144c service nova] Acquiring lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-58f23808-e841-4ccb-9047-5024375be5e3 req-f35c626a-633d-428d-b86c-9518e069144c service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-58f23808-e841-4ccb-9047-5024375be5e3 req-f35c626a-633d-428d-b86c-9518e069144c service nova] Lock "b8ceea92-f765-46a7-8851-3bdacb386732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-58f23808-e841-4ccb-9047-5024375be5e3 req-f35c626a-633d-428d-b86c-9518e069144c service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] No waiting events found dispatching network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:37 user nova-compute[75244]: WARNING nova.compute.manager [req-58f23808-e841-4ccb-9047-5024375be5e3 req-f35c626a-633d-428d-b86c-9518e069144c service nova] [instance: b8ceea92-f765-46a7-8851-3bdacb386732] Received unexpected event network-vif-plugged-39466e90-10cb-4540-bd33-8ef69252ced7 for instance with vm_state deleted and task_state None.
Nov 29 23:10:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-89004932-5ab0-4afd-a009-9099912d4a80 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "b8ceea92-f765-46a7-8851-3bdacb386732" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:38 user nova-compute[75244]: INFO nova.compute.manager [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Terminating instance
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-857d02d0-e163-4443-bf08-ed3af765b9f4 req-a697bdda-bcbc-420a-8605-d7ad3c606ed4 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-unplugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-857d02d0-e163-4443-bf08-ed3af765b9f4 req-a697bdda-bcbc-420a-8605-d7ad3c606ed4 service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-857d02d0-e163-4443-bf08-ed3af765b9f4 req-a697bdda-bcbc-420a-8605-d7ad3c606ed4 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-857d02d0-e163-4443-bf08-ed3af765b9f4 req-a697bdda-bcbc-420a-8605-d7ad3c606ed4 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-857d02d0-e163-4443-bf08-ed3af765b9f4 req-a697bdda-bcbc-420a-8605-d7ad3c606ed4 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-unplugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-857d02d0-e163-4443-bf08-ed3af765b9f4 req-a697bdda-bcbc-420a-8605-d7ad3c606ed4 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-unplugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:10:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Instance destroyed successfully.
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.objects.instance [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lazy-loading 'resources' on Instance uuid f285c6d6-ccb5-419a-94df-0d608f08c33c {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1985742742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1038057022',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5E3Tsq5bbF9bdpJnsYkIAIienF8hmPQXzNUhNp2gKZCBRd+lp43mKtu7gxh++Wp6Li9ezdn0RmsDzgcwlFYEzAWJqfRjy5edd4uf7DcDG3fiiq9ZHensfgVJTB4AOg==',key_name='tempest-keypair-637915247',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c65023bfd4a461fbbc63d2c08d930a8',ramdisk_id='',reservation_id='r-br52rfyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-439423886',owner_user_name='tempest-ServerActionsV293TestJSON-439423886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd93ba0909bd44dfae59be5b157cb0cf',uuid=f285c6d6-ccb5-419a-94df-0d608f08c33c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converting VIF {"id": "475156ec-7744-46e6-95f8-9703c9f6f777", "address": "fa:16:3e:39:ab:a5", "network": {"id": "d03bd697-b447-40fa-a04e-8fbf23bead08", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1494102524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65023bfd4a461fbbc63d2c08d930a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap475156ec-77", "ovs_interfaceid": "475156ec-7744-46e6-95f8-9703c9f6f777", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_vif [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap475156ec-77, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=903337a7-054e-43ce-8d3c-cc034957a28f) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:39 user nova-compute[75244]: INFO os_vif [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ab:a5,bridge_name='br-int',has_traffic_filtering=True,id=475156ec-7744-46e6-95f8-9703c9f6f777,network=Network(d03bd697-b447-40fa-a04e-8fbf23bead08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap475156ec-77')
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCRYaZwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:10:39 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c0642-91e9-4917-ace8-17af91b179fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:10:39 user nova-compute[75244]: No targets found.
Nov 29 23:10:39 user nova-compute[75244]: iSNS:
Nov 29 23:10:39 user nova-compute[75244]: No targets found.
Nov 29 23:10:39 user nova-compute[75244]: STATIC:
Nov 29 23:10:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8
Nov 29 23:10:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:10:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:10:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:10:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:10:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:10:39 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:10:39 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:10:39 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:10:39 user nova-compute[75244]: FIRMWARE:
Nov 29 23:10:39 user nova-compute[75244]: No targets found.
Nov 29 23:10:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:10:39 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:10:39 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a7a595-47ad-4711-8f82-281a3a6aa658]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0db6d-a51f-49c0-9882-491f2d6dbeba]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:39 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:39 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:10:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 (non-flash)
Nov 29 23:10:39 user nova-compute[75244]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:10:39 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:10:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8163deb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2a7393-e3fc-4128-9be4-c64ab2657a66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb13b143-f9b5-4929-9fd6-dc0e6001cfea]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34783be-8cc7-4f5a-8c37-5ae252c69f8a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f0cb3-28db-41d9-9e38-afa2b5017e7a]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aec040d5', '/dev/disk/by-id/scsi-1SCST_BIOaec040d5-303e72c2b350587d', '/dev/disk/by-id/scsi-23330336537326332') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e64e46d-020f-4d10-b36e-98c411ad73df]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2366f-cfbe-4993-939b-61377da2364d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d134e87-5581-4193-b5d5-41efee64a65d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260]
Nov 29 23:10:39 user nova-compute[75244]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8, portal: 172.16.0.220,3260] successful.
Nov 29 23:10:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c294d3d-4c05-473a-a2dc-95a642351df8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1466c0-4dc4-40c0-b2cc-fdc91affe658]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] <== disconnect_volume: return (374ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:10:39 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Deleting instance files /opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c_del
Nov 29 23:10:39 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Deletion of /opt/stack/data/nova/instances/f285c6d6-ccb5-419a-94df-0d608f08c33c_del complete
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:39 user nova-compute[75244]: INFO nova.compute.manager [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-c433aabc-6199-499e-8854-3abd3fab0c1d req-c6a6b348-70d5-459d-b84e-ab057e347b27 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-deleted-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:40 user nova-compute[75244]: INFO nova.compute.manager [req-c433aabc-6199-499e-8854-3abd3fab0c1d req-c6a6b348-70d5-459d-b84e-ab057e347b27 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Neutron deleted interface 475156ec-7744-46e6-95f8-9703c9f6f777; detaching it from the instance and deleting it from the info cache
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-c433aabc-6199-499e-8854-3abd3fab0c1d req-c6a6b348-70d5-459d-b84e-ab057e347b27 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:10:40 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Took 0.69 seconds to deallocate network for instance.
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-c433aabc-6199-499e-8854-3abd3fab0c1d req-c6a6b348-70d5-459d-b84e-ab057e347b27 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Detach interface failed, port_id=475156ec-7744-46e6-95f8-9703c9f6f777, reason: Instance f285c6d6-ccb5-419a-94df-0d608f08c33c could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:10:40 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:10:40 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7669MB free_disk=25.289409637451172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-307bf5a5-6ae2-4ecd-bf43-e79c640e66ca req-a6ba4c41-35ca-444e-b117-6b203be87d17 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-307bf5a5-6ae2-4ecd-bf43-e79c640e66ca req-a6ba4c41-35ca-444e-b117-6b203be87d17 service nova] Acquiring lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-307bf5a5-6ae2-4ecd-bf43-e79c640e66ca req-a6ba4c41-35ca-444e-b117-6b203be87d17 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-307bf5a5-6ae2-4ecd-bf43-e79c640e66ca req-a6ba4c41-35ca-444e-b117-6b203be87d17 service nova] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-307bf5a5-6ae2-4ecd-bf43-e79c640e66ca req-a6ba4c41-35ca-444e-b117-6b203be87d17 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] No waiting events found dispatching network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:10:40 user nova-compute[75244]: WARNING nova.compute.manager [req-307bf5a5-6ae2-4ecd-bf43-e79c640e66ca req-a6ba4c41-35ca-444e-b117-6b203be87d17 service nova] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Received unexpected event network-vif-plugged-475156ec-7744-46e6-95f8-9703c9f6f777 for instance with vm_state active and task_state deleting.
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f285c6d6-ccb5-419a-94df-0d608f08c33c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5eadf8f0-a801-47b5-99d8-34812a0d83db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 24054fdc-8f5e-4352-bdfa-717f288152bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 089b181a-b746-4a25-94ad-50fd268a7cd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:10:41 user nova-compute[75244]: INFO nova.compute.manager [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] [instance: f285c6d6-ccb5-419a-94df-0d608f08c33c] Deleting volume: 1c294d3d-4c05-473a-a2dc-95a642351df8 {{(pid=75244) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:10:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:41 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Deleted allocations for instance f285c6d6-ccb5-419a-94df-0d608f08c33c
Nov 29 23:10:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9619be5b-50a1-471c-8527-0e5c7afd4b1a tempest-ServerActionsV293TestJSON-439423886 tempest-ServerActionsV293TestJSON-439423886-project-member] Lock "f285c6d6-ccb5-419a-94df-0d608f08c33c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.340s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:10:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:10:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:10:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:10:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'flavor' on Instance uuid 5eadf8f0-a801-47b5-99d8-34812a0d83db {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-changed-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Refreshing instance network info cache due to event network-changed-beb2df2b-5192-4d17-8e62-09c480ce6e36. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Refreshing network info cache for port beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:03 user nova-compute[75244]: INFO nova.compute.manager [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Attaching volume 5348d649-9d67-419b-9f9b-cb4d6265201e to /dev/vdb
Nov 29 23:11:03 user nova-compute[75244]: DEBUG os_brick.utils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d143bbd1-21f6-4937-86ba-8e3a2edff8f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a7c36-6c6d-4438-8660-18e0dc0413d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[40614dee-7e83-47bc-ac9e-6b25b58164d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7227b23-4db1-46f8-8c81-3cb92fe919d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:11:03 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:11:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[581111d4-649b-4926-afe3-d1f7ccbe47b8]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG os_brick.utils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating existing volume attachment record: f0cef78b-759a-46e3-9782-e728967593bd {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updated VIF entry in instance network info cache for port beb2df2b-5192-4d17-8e62-09c480ce6e36. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-76b22f5d-fd5e-40e1-9f30-52c2b0b1283d req-3be2e304-1173-4eba-9f3a-0cc32edbdf3e service nova] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:11:06 user nova-compute[75244]: INFO nova.compute.claims [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Claim successful on node user
Nov 29 23:11:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-changed-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing instance network info cache due to event network-changed-e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:06 user nova-compute[75244]: DEBUG nova.network.neutron [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing network info cache for port e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:11:07 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.policy [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6d9dd0466344edc8b9aad74fd1fe1b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f36d441ef074e09bcb59e29b03b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:11:07 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Creating image(s)
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "/opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "/opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "/opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updated VIF entry in instance network info cache for port e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6015a5fe-6ef0-4b2f-9b14-ee591b885bca req-8d14bada-4808-4534-b27b-3e23248d44f6 service nova] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk 1073741824" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:11:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Successfully created port: b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Cannot resize image /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Ensure instance console log exists: /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Successfully updated port: b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-changed-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Refreshing instance network info cache due to event network-changed-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Instance network_info: |[{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.neutron [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Refreshing network info cache for port b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Start _get_guest_xml network_info=[{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:11:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1584162890',display_name='tempest-ServerActionsTestOtherA-server-1584162890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1584162890',id=25,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-s6sm2i0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=e568eb15-8140-486d-a8a9-a2b5e726ad60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'pci_devices' on Instance uuid e568eb15-8140-486d-a8a9-a2b5e726ad60 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:11:09 user nova-compute[75244]:   <uuid>e568eb15-8140-486d-a8a9-a2b5e726ad60</uuid>
Nov 29 23:11:09 user nova-compute[75244]:   <name>instance-00000019</name>
Nov 29 23:11:09 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:11:09 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:11:09 user nova-compute[75244]:   <metadata>
Nov 29 23:11:09 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:11:09 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:11:09 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherA-server-1584162890</nova:name>
Nov 29 23:11:09 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:11:09</nova:creationTime>
Nov 29 23:11:09 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:11:09 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:11:09 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:11:09 user nova-compute[75244]:       <nova:owner>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:user uuid="c6d9dd0466344edc8b9aad74fd1fe1b0">tempest-ServerActionsTestOtherA-1557642123-project-member</nova:user>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:project uuid="6f36d441ef074e09bcb59e29b03b5e77">tempest-ServerActionsTestOtherA-1557642123</nova:project>
Nov 29 23:11:09 user nova-compute[75244]:       </nova:owner>
Nov 29 23:11:09 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:11:09 user nova-compute[75244]:       <nova:ports>
Nov 29 23:11:09 user nova-compute[75244]:         <nova:port uuid="b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d">
Nov 29 23:11:09 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 23:11:09 user nova-compute[75244]:         </nova:port>
Nov 29 23:11:09 user nova-compute[75244]:       </nova:ports>
Nov 29 23:11:09 user nova-compute[75244]:     </nova:instance>
Nov 29 23:11:09 user nova-compute[75244]:   </metadata>
Nov 29 23:11:09 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:11:09 user nova-compute[75244]:     <system>
Nov 29 23:11:09 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:11:09 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:11:09 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:11:09 user nova-compute[75244]:       <entry name="serial">e568eb15-8140-486d-a8a9-a2b5e726ad60</entry>
Nov 29 23:11:09 user nova-compute[75244]:       <entry name="uuid">e568eb15-8140-486d-a8a9-a2b5e726ad60</entry>
Nov 29 23:11:09 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:11:09 user nova-compute[75244]:     </system>
Nov 29 23:11:09 user nova-compute[75244]:   </sysinfo>
Nov 29 23:11:09 user nova-compute[75244]:   <os>
Nov 29 23:11:09 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:11:09 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:11:09 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:11:09 user nova-compute[75244]:   </os>
Nov 29 23:11:09 user nova-compute[75244]:   <features>
Nov 29 23:11:09 user nova-compute[75244]:     <acpi/>
Nov 29 23:11:09 user nova-compute[75244]:     <apic/>
Nov 29 23:11:09 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:11:09 user nova-compute[75244]:   </features>
Nov 29 23:11:09 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:11:09 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:11:09 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:11:09 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:11:09 user nova-compute[75244]:   </clock>
Nov 29 23:11:09 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:11:09 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:11:09 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:11:09 user nova-compute[75244]:   </cpu>
Nov 29 23:11:09 user nova-compute[75244]:   <devices>
Nov 29 23:11:09 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:11:09 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:11:09 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk"/>
Nov 29 23:11:09 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:11:09 user nova-compute[75244]:     </disk>
Nov 29 23:11:09 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:11:09 user nova-compute[75244]:       <mac address="fa:16:3e:c4:d6:45"/>
Nov 29 23:11:09 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:09 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:11:09 user nova-compute[75244]:       <target dev="tapb7e4f9aa-f0"/>
Nov 29 23:11:09 user nova-compute[75244]:     </interface>
Nov 29 23:11:09 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:11:09 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/console.log" append="off"/>
Nov 29 23:11:09 user nova-compute[75244]:     </serial>
Nov 29 23:11:09 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:11:09 user nova-compute[75244]:     <video>
Nov 29 23:11:09 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:09 user nova-compute[75244]:     </video>
Nov 29 23:11:09 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:11:09 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:11:09 user nova-compute[75244]:     </rng>
Nov 29 23:11:09 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:11:09 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:11:09 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:11:09 user nova-compute[75244]:     </memballoon>
Nov 29 23:11:09 user nova-compute[75244]:   </devices>
Nov 29 23:11:09 user nova-compute[75244]: </domain>
Nov 29 23:11:09 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1584162890',display_name='tempest-ServerActionsTestOtherA-server-1584162890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1584162890',id=25,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-s6sm2i0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=e568eb15-8140-486d-a8a9-a2b5e726ad60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG os_vif [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31bb9c84-13e2-5d0b-b5d4-8ea9a8811f8b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7e4f9aa-f0, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7e4f9aa-f0, col_values=(('qos', UUID('7a8ad7da-0734-4fe3-9606-8cb46e96ff55')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7e4f9aa-f0, col_values=(('external_ids', {'iface-id': 'b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:d6:45', 'vm-uuid': 'e568eb15-8140-486d-a8a9-a2b5e726ad60'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:09 user nova-compute[75244]: INFO os_vif [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0')
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No VIF found with MAC fa:16:3e:c4:d6:45, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated VIF entry in instance network info cache for port b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3c56831a-ea51-49af-9f21-cbf92f4d4cc1 req-faf7c233-d2f6-4aa9-b28f-ae27cdd2f7c4 service nova] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing instance network info cache due to event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:10 user nova-compute[75244]: INFO nova.compute.manager [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Shelving
Nov 29 23:11:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG nova.network.neutron [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updated VIF entry in instance network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG nova.network.neutron [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0dfb1b4d-2263-46d8-893a-e5c6c14c329d req-21a0b9aa-a541-4950-9e8f-b132a70171b7 service nova] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:11 user nova-compute[75244]: INFO nova.compute.manager [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Shelve offloading
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-2a27728b-d7e6-4c85-98b1-88cfc7687f86 req-5f6c1a45-99b8-4b12-bab4-24d99ce1e1e1 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2a27728b-d7e6-4c85-98b1-88cfc7687f86 req-5f6c1a45-99b8-4b12-bab4-24d99ce1e1e1 service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2a27728b-d7e6-4c85-98b1-88cfc7687f86 req-5f6c1a45-99b8-4b12-bab4-24d99ce1e1e1 service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2a27728b-d7e6-4c85-98b1-88cfc7687f86 req-5f6c1a45-99b8-4b12-bab4-24d99ce1e1e1 service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-2a27728b-d7e6-4c85-98b1-88cfc7687f86 req-5f6c1a45-99b8-4b12-bab4-24d99ce1e1e1 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:11 user nova-compute[75244]: WARNING nova.compute.manager [req-2a27728b-d7e6-4c85-98b1-88cfc7687f86 req-5f6c1a45-99b8-4b12-bab4-24d99ce1e1e1 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state shelving.
Nov 29 23:11:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance destroyed successfully.
Nov 29 23:11:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Beginning cold snapshot process
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwmzqTOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:11:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:11:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:11:12 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de01e676-4b3e-433d-af4d-1dc3869b5d3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:11:12 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6429ca81-4824-4fbb-a203-bf05f249a228]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e] added
Nov 29 23:11:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5ac3c1-1311-4369-8a54-0791111826fb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk /opt/stack/data/nova/instances/snapshots/tmpg6rs4nse/b3508abe35fa489a995a9b0cddc4a0fb {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ace1235-6dfe-479b-a45c-82d53b9a4402]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwmzqTOD {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwmzqTOD" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de04dcb-2249-4e30-a5c3-56bbf26f5534]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwmzqTOD'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4a251d-6782-4fe9-9284-490086036b34]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0a1dd6-dc9f-470e-bc1b-a87d4a191750]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:11:12 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:11:12 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance destroyed successfully.
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110f901-dce7-4ed9-b0b5-b1bdc138d36f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260]
Nov 29 23:11:12 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260] successful.
Nov 29 23:11:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5320c-7c10-4107-835c-434173500667]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e30e65d-411e-42b1-bb98-13a491d68aea]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:11:12 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:12 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:11:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:11:12 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:12 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:11:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c346fa87-515a-42a3-a47b-b52dbbbbbe20]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:12 user nova-compute[75244]: WARNING nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:12 user nova-compute[75244]: WARNING nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] No waiting events found dispatching network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:12 user nova-compute[75244]: WARNING nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received unexpected event network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d for instance with vm_state building and task_state spawning.
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] No waiting events found dispatching network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:12 user nova-compute[75244]: WARNING nova.compute.manager [req-fcc68bbd-efe2-4225-9d78-e1e4b34e9e2a req-ef800cf8-e328-4638-b77b-c8e8e7a79aa7 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received unexpected event network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d for instance with vm_state building and task_state spawning.
Nov 29 23:11:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk /opt/stack/data/nova/instances/snapshots/tmpg6rs4nse/b3508abe35fa489a995a9b0cddc4a0fb" returned: 0 in 0.975s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Snapshot extracted, beginning image upload
Nov 29 23:11:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance destroyed successfully.
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'resources' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2123477696',display_name='tempest-TestShelveInstance-server-2123477696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2123477696',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL742LDaSYEIJTG907ugPcoBYVgqmhGoBMpBoZpcEMdn3/W8GzfjUv2h9hWAysqCjwIGr4cnPexh2SKIBfkgaxCwjzJggxvP5FLaGh/etBhuzzY4w3WIZCOCsin6CpECg==',key_name='tempest-TestShelveInstance-888719108',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0258ba7ccde40a09e3e251fbef77431',ramdisk_id='',reservation_id='r-i514jhss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1542675207',owner_user_name='tempest-TestShelveInstance-1542675207-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:09:34Z,user_data=None,user_id='476af5a1d41146788ce60db8a2683f23',uuid=089b181a-b746-4a25-94ad-50fd268a7cd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converting VIF {"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_vif [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb3b5745-66, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing instance network info cache due to event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6e79dd3-3d1e-47bb-ace3-95a9af570271) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:13 user nova-compute[75244]: INFO os_vif [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66')
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:11:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwmzqTOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.570s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== connect_volume: return (1571ms) {'type': 'block', 'scsi_wwn': '26234643839366263', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234643839366263', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.152s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed06e6fb-fe47-408f-aa9b-fb9e867c0ed7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:11:13 user nova-compute[75244]: No targets found.
Nov 29 23:11:13 user nova-compute[75244]: iSNS:
Nov 29 23:11:13 user nova-compute[75244]: No targets found.
Nov 29 23:11:13 user nova-compute[75244]: STATIC:
Nov 29 23:11:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e
Nov 29 23:11:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:11:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:11:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:11:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:11:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:11:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:11:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:11:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:11:13 user nova-compute[75244]: FIRMWARE:
Nov 29 23:11:13 user nova-compute[75244]: No targets found.
Nov 29 23:11:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:11:13 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:11:13 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0020e8d6-c757-4fdb-80a5-0ec87d2e9514]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f1c624-9f34-46f1-b122-fd00cecbe552]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:11:13 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:13 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:11:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:11:13 user nova-compute[75244]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:13 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:11:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80472edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af'): ({'sdf'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Removing single pathed devices sdf {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671bcfa-7bd2-41a3-913d-ede857fb74a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'flavor' on Instance uuid 5eadf8f0-a801-47b5-99d8-34812a0d83db {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dfd3c4-6fa1-450e-aba1-812701da82b3]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Flushing IO for device /dev/sdf {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:11:13 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:11:13 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:11:13 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:11:13 user nova-compute[75244]:   <serial>5348d649-9d67-419b-9f9b-cb4d6265201e</serial>
Nov 29 23:11:13 user nova-compute[75244]: </disk>
Nov 29 23:11:13 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:13 user nova-compute[75244]: WARNING nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state shelving.
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:13 user nova-compute[75244]: WARNING nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state shelving.
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:13 user nova-compute[75244]: WARNING nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state shelving.
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:13 user nova-compute[75244]: WARNING nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state shelving.
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:13 user nova-compute[75244]: WARNING nova.compute.manager [req-084cc1a2-e7d1-4388-8282-b9ac3193c404 req-cb31d9b3-a990-4d96-b929-a7961ab9307a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state shelving.
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf182c-228d-487e-9e68-2a872f3f4352]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[64905d5e-e839-48af-911e-2e2a3d661f80]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc52e6-8394-4633-b856-c3a7c68f02ad]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e6094f-c51e-43d0-a0e1-e060230d2744]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]
Nov 29 23:11:13 user nova-compute[75244]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.
Nov 29 23:11:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd8ab1-073b-40d6-b6ff-edf530868ee8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] <== disconnect_volume: return (513ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:11:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Deleting instance files /opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9_del
Nov 29 23:11:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Deletion of /opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9_del complete
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updated VIF entry in instance network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": null, "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcb3b5745-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73e581ec-1959-471a-9ba6-4f97b135d5ac req-25f10d05-74a0-475d-9931-4e569a01ff91 service nova] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] No VIF found with MAC fa:16:3e:d9:c1:0a, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c0550e74-0458-4c80-8912-db5326a337f0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.860s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:11:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Instance spawned successfully.
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:14 user nova-compute[75244]: INFO nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Took 7.46 seconds to spawn the instance on the hypervisor.
Nov 29 23:11:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:14 user nova-compute[75244]: INFO nova.compute.manager [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Took 8.25 seconds to build instance.
Nov 29 23:11:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6cbed0c5-bdcd-4499-b310-d20a5d7abdd2 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.433s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:15 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Deleted allocations for instance 089b181a-b746-4a25-94ad-50fd268a7cd9
Nov 29 23:11:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'numa_topology' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.objects.base [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Object Instance<089b181a-b746-4a25-94ad-50fd268a7cd9> lazy-loaded attributes: resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6421e34b-5539-431a-b4cc-88c19acc3abd tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.468s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Snapshot image upload complete
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:15 user nova-compute[75244]: INFO nova.compute.manager [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Shelve offloading
Nov 29 23:11:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance destroyed successfully.
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance destroyed successfully.
Nov 29 23:11:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'resources' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486852029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486852029',id=22,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCC67DzG1riKGxi2wUbXu8EmjvRfVhTQnD6socBdd5qUlfc30W3AZ8lpHpQVcfr3eD3zoaTTFqx/r9VKbu1vB5DLu34KfDPjQJ4BRFCCjn7VFZOTWVP+WvaxudiQmh0Lw==',key_name='tempest-keypair-17102318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-d87zlrs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member',shelved_at='2023-11-29T23:11:15.824698',shelved_host='user',shelved_image_id='f08acb67-db00-43c7-ba3a-f197daf5683c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=24054fdc-8f5e-4352-bdfa-717f288152bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG os_vif [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape96d8f49-a3, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5abd6d6a-5f51-419a-9f07-1c25cc2bc8a2) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:16 user nova-compute[75244]: INFO os_vif [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3')
Nov 29 23:11:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Deleting instance files /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf_del
Nov 29 23:11:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Deletion of /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf_del complete
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-changed-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing instance network info cache due to event network-changed-e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing network info cache for port e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:17 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Deleted allocations for instance 24054fdc-8f5e-4352-bdfa-717f288152bf
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'numa_topology' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.objects.base [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<24054fdc-8f5e-4352-bdfa-717f288152bf> lazy-loaded attributes: resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updated VIF entry in instance network info cache for port e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape96d8f49-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7487d3a9-0b09-4164-aae4-94329af58cd7 req-2ad46a10-336a-491c-9739-92c4b64d5963 service nova] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5042a53e-ae66-470a-82ca-b1f1b1af953a tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.672s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-changed-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing instance network info cache due to event network-changed-17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG nova.network.neutron [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG nova.network.neutron [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updated VIF entry in instance network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG nova.network.neutron [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d860779-f027-4998-89eb-e5e306d59c95 req-a5929088-8fc1-462f-9fac-a5e1ec3f04e6 service nova] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-changed-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing instance network info cache due to event network-changed-17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG nova.network.neutron [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updated VIF entry in instance network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG nova.network.neutron [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-397b2b87-08a0-4332-b71b-b8d618242362 req-01e00576-dfdb-4dbb-b178-37dc1d671e8a service nova] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:21 user nova-compute[75244]: INFO nova.compute.manager [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Rebooting instance
Nov 29 23:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:22 user nova-compute[75244]: DEBUG nova.network.neutron [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-e97f7b64-1a19-4006-9ac3-220c8255a276 req-b622c3f0-4c00-4fc6-8137-6e8006da09ec service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-unplugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e97f7b64-1a19-4006-9ac3-220c8255a276 req-b622c3f0-4c00-4fc6-8137-6e8006da09ec service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e97f7b64-1a19-4006-9ac3-220c8255a276 req-b622c3f0-4c00-4fc6-8137-6e8006da09ec service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e97f7b64-1a19-4006-9ac3-220c8255a276 req-b622c3f0-4c00-4fc6-8137-6e8006da09ec service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-e97f7b64-1a19-4006-9ac3-220c8255a276 req-b622c3f0-4c00-4fc6-8137-6e8006da09ec service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-unplugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:25 user nova-compute[75244]: WARNING nova.compute.manager [req-e97f7b64-1a19-4006-9ac3-220c8255a276 req-b622c3f0-4c00-4fc6-8137-6e8006da09ec service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-unplugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state active and task_state reboot_started.
Nov 29 23:11:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance shutdown successfully.
Nov 29 23:11:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG nova.compute.manager [req-0de6c5c2-6a3e-4908-a7fb-2d09659b205a req-7e9c0d2e-a984-4942-ba06-141fb88037ff service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0de6c5c2-6a3e-4908-a7fb-2d09659b205a req-7e9c0d2e-a984-4942-ba06-141fb88037ff service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0de6c5c2-6a3e-4908-a7fb-2d09659b205a req-7e9c0d2e-a984-4942-ba06-141fb88037ff service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0de6c5c2-6a3e-4908-a7fb-2d09659b205a req-7e9c0d2e-a984-4942-ba06-141fb88037ff service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG nova.compute.manager [req-0de6c5c2-6a3e-4908-a7fb-2d09659b205a req-7e9c0d2e-a984-4942-ba06-141fb88037ff service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:27 user nova-compute[75244]: WARNING nova.compute.manager [req-0de6c5c2-6a3e-4908-a7fb-2d09659b205a req-7e9c0d2e-a984-4942-ba06-141fb88037ff service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state active and task_state reboot_started.
Nov 29 23:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:11:28 user nova-compute[75244]: INFO nova.compute.claims [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Claim successful on node user
Nov 29 23:11:28 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:11:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.policy [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbdba67b1fdb470194c5a15ee3c4baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f830c5f8f3641f1938b103eae582ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:11:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Creating image(s)
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "/opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:29 user nova-compute[75244]: WARNING nova.compute.manager [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state active and task_state reboot_started.
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:29 user nova-compute[75244]: WARNING nova.compute.manager [req-ea482f86-e07b-4a15-a6a5-50000c084369 req-48f92762-cabe-4450-902e-b2296293ea00 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state active and task_state reboot_started.
Nov 29 23:11:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance running successfully.
Nov 29 23:11:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance soft rebooted successfully.
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-42df6d81-d613-4839-849f-b5df56f6a71f tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.882s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.220s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk 1073741824" returned: 0 in 0.063s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Successfully created port: 1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:11:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Cannot resize image /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Ensure instance console log exists: /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Successfully updated port: 1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquired lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-changed-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Refreshing instance network info cache due to event network-changed-1060dd82-54d4-4288-90bf-131c63174ffc. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] Acquiring lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updating instance_info_cache with network_info: [{"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Releasing lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Instance network_info: |[{"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] Acquired lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.network.neutron [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Refreshing network info cache for port 1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Start _get_guest_xml network_info=[{"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:11:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-822058595',display_name='tempest-AttachVolumeNegativeTest-server-822058595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-822058595',id=26,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYVVi4LWa1thEwKrHPaC2OFDZY3mo8qtKID4139NkPPob4T0psLHQr2wfb2FssY2rrlhQMVzz5XNjpi4UT0stQoGZHKk2m0KDyRFKRXM3XxXwYNsQGmaW79+IgrQaXhow==',key_name='tempest-keypair-1928654152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-h0yd8e0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:11:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=90872dcf-9b55-4ed2-b52b-6d10eef6e4dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.objects.instance [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'pci_devices' on Instance uuid 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:11:31 user nova-compute[75244]:   <uuid>90872dcf-9b55-4ed2-b52b-6d10eef6e4dd</uuid>
Nov 29 23:11:31 user nova-compute[75244]:   <name>instance-0000001a</name>
Nov 29 23:11:31 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:11:31 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:11:31 user nova-compute[75244]:   <metadata>
Nov 29 23:11:31 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:11:31 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:11:31 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeNegativeTest-server-822058595</nova:name>
Nov 29 23:11:31 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:11:30</nova:creationTime>
Nov 29 23:11:31 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:11:31 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:11:31 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:11:31 user nova-compute[75244]:       <nova:owner>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:user uuid="dbdba67b1fdb470194c5a15ee3c4baee">tempest-AttachVolumeNegativeTest-750809743-project-member</nova:user>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:project uuid="2f830c5f8f3641f1938b103eae582ccd">tempest-AttachVolumeNegativeTest-750809743</nova:project>
Nov 29 23:11:31 user nova-compute[75244]:       </nova:owner>
Nov 29 23:11:31 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:11:31 user nova-compute[75244]:       <nova:ports>
Nov 29 23:11:31 user nova-compute[75244]:         <nova:port uuid="1060dd82-54d4-4288-90bf-131c63174ffc">
Nov 29 23:11:31 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:11:31 user nova-compute[75244]:         </nova:port>
Nov 29 23:11:31 user nova-compute[75244]:       </nova:ports>
Nov 29 23:11:31 user nova-compute[75244]:     </nova:instance>
Nov 29 23:11:31 user nova-compute[75244]:   </metadata>
Nov 29 23:11:31 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:11:31 user nova-compute[75244]:     <system>
Nov 29 23:11:31 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:11:31 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:11:31 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:11:31 user nova-compute[75244]:       <entry name="serial">90872dcf-9b55-4ed2-b52b-6d10eef6e4dd</entry>
Nov 29 23:11:31 user nova-compute[75244]:       <entry name="uuid">90872dcf-9b55-4ed2-b52b-6d10eef6e4dd</entry>
Nov 29 23:11:31 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:11:31 user nova-compute[75244]:     </system>
Nov 29 23:11:31 user nova-compute[75244]:   </sysinfo>
Nov 29 23:11:31 user nova-compute[75244]:   <os>
Nov 29 23:11:31 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:11:31 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:11:31 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:11:31 user nova-compute[75244]:   </os>
Nov 29 23:11:31 user nova-compute[75244]:   <features>
Nov 29 23:11:31 user nova-compute[75244]:     <acpi/>
Nov 29 23:11:31 user nova-compute[75244]:     <apic/>
Nov 29 23:11:31 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:11:31 user nova-compute[75244]:   </features>
Nov 29 23:11:31 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:11:31 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:11:31 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:11:31 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:11:31 user nova-compute[75244]:   </clock>
Nov 29 23:11:31 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:11:31 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:11:31 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:11:31 user nova-compute[75244]:   </cpu>
Nov 29 23:11:31 user nova-compute[75244]:   <devices>
Nov 29 23:11:31 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:11:31 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:11:31 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk"/>
Nov 29 23:11:31 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:11:31 user nova-compute[75244]:     </disk>
Nov 29 23:11:31 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:11:31 user nova-compute[75244]:       <mac address="fa:16:3e:a6:d4:4e"/>
Nov 29 23:11:31 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:31 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:11:31 user nova-compute[75244]:       <target dev="tap1060dd82-54"/>
Nov 29 23:11:31 user nova-compute[75244]:     </interface>
Nov 29 23:11:31 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:11:31 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/console.log" append="off"/>
Nov 29 23:11:31 user nova-compute[75244]:     </serial>
Nov 29 23:11:31 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:11:31 user nova-compute[75244]:     <video>
Nov 29 23:11:31 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:31 user nova-compute[75244]:     </video>
Nov 29 23:11:31 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:11:31 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:11:31 user nova-compute[75244]:     </rng>
Nov 29 23:11:31 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:11:31 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:11:31 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:11:31 user nova-compute[75244]:     </memballoon>
Nov 29 23:11:31 user nova-compute[75244]:   </devices>
Nov 29 23:11:31 user nova-compute[75244]: </domain>
Nov 29 23:11:31 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-822058595',display_name='tempest-AttachVolumeNegativeTest-server-822058595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-822058595',id=26,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYVVi4LWa1thEwKrHPaC2OFDZY3mo8qtKID4139NkPPob4T0psLHQr2wfb2FssY2rrlhQMVzz5XNjpi4UT0stQoGZHKk2m0KDyRFKRXM3XxXwYNsQGmaW79+IgrQaXhow==',key_name='tempest-keypair-1928654152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-h0yd8e0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:11:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=90872dcf-9b55-4ed2-b52b-6d10eef6e4dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG os_vif [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd83e218e-1db6-55f2-a99d-1c6daa216fff', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1060dd82-54, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1060dd82-54, col_values=(('qos', UUID('cda44215-bfe3-47a6-8929-53e9f22f4c9f')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1060dd82-54, col_values=(('external_ids', {'iface-id': '1060dd82-54d4-4288-90bf-131c63174ffc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:d4:4e', 'vm-uuid': '90872dcf-9b55-4ed2-b52b-6d10eef6e4dd'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:31 user nova-compute[75244]: INFO os_vif [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54')
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:a6:d4:4e, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updated VIF entry in instance network info cache for port 1060dd82-54d4-4288-90bf-131c63174ffc. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updating instance_info_cache with network_info: [{"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f8bf4c2f-3d79-41ab-8bb1-27865a6308c9 req-1438552d-c612-42cc-b55b-379a4a005ae8 service nova] Releasing lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-f6ee9d43-461b-4520-8b72-18c236b7157b req-6c31671f-6f0b-4985-aa1b-8242a4b5eccb service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f6ee9d43-461b-4520-8b72-18c236b7157b req-6c31671f-6f0b-4985-aa1b-8242a4b5eccb service nova] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f6ee9d43-461b-4520-8b72-18c236b7157b req-6c31671f-6f0b-4985-aa1b-8242a4b5eccb service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f6ee9d43-461b-4520-8b72-18c236b7157b req-6c31671f-6f0b-4985-aa1b-8242a4b5eccb service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-f6ee9d43-461b-4520-8b72-18c236b7157b req-6c31671f-6f0b-4985-aa1b-8242a4b5eccb service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] No waiting events found dispatching network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:32 user nova-compute[75244]: WARNING nova.compute.manager [req-f6ee9d43-461b-4520-8b72-18c236b7157b req-6c31671f-6f0b-4985-aa1b-8242a4b5eccb service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received unexpected event network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc for instance with vm_state building and task_state spawning.
Nov 29 23:11:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:11:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Instance spawned successfully.
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-edc6fffe-6b69-455e-b7d8-a60f696dfdc7 req-717617aa-8860-49c2-87f3-09fed5e031ad service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-edc6fffe-6b69-455e-b7d8-a60f696dfdc7 req-717617aa-8860-49c2-87f3-09fed5e031ad service nova] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-edc6fffe-6b69-455e-b7d8-a60f696dfdc7 req-717617aa-8860-49c2-87f3-09fed5e031ad service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-edc6fffe-6b69-455e-b7d8-a60f696dfdc7 req-717617aa-8860-49c2-87f3-09fed5e031ad service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-edc6fffe-6b69-455e-b7d8-a60f696dfdc7 req-717617aa-8860-49c2-87f3-09fed5e031ad service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] No waiting events found dispatching network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:34 user nova-compute[75244]: WARNING nova.compute.manager [req-edc6fffe-6b69-455e-b7d8-a60f696dfdc7 req-717617aa-8860-49c2-87f3-09fed5e031ad service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received unexpected event network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc for instance with vm_state building and task_state spawning.
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:35 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:35 user nova-compute[75244]: INFO nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 29 23:11:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:11:35 user nova-compute[75244]: INFO nova.compute.manager [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Took 6.57 seconds to build instance.
Nov 29 23:11:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-35b193e8-8e54-4fbd-9d99-16e890a34b67 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:41 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:41 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8081MB free_disk=25.226654052734375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5eadf8f0-a801-47b5-99d8-34812a0d83db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:11:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:45 user nova-compute[75244]: INFO nova.compute.manager [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Terminating instance
Nov 29 23:11:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.compute.claims [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Claim successful on node user
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Instance destroyed successfully.
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'resources' on Instance uuid 019c268b-dc0f-4e68-95e2-f26f5c24463b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2138708551',display_name='tempest-AttachVolumeTestJSON-server-2138708551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2138708551',id=3,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4k90afZp4ifWrRPVaY9k7+yuMqJR7pSk8tO6XXfpvydk7mbqDcjlqirtyS/d2oxkKhLzo1UN0do+hDyFciPgBEUDyQD4MXz43Mfm1YqDic8ecCEoY9bl/idmlRWYRvQ==',key_name='tempest-keypair-883181406',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-vdb97tzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=019c268b-dc0f-4e68-95e2-f26f5c24463b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "69add1a4-a188-4454-9331-c39bffcd8b49", "address": "fa:16:3e:96:27:05", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69add1a4-a1", "ovs_interfaceid": "69add1a4-a188-4454-9331-c39bffcd8b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG os_vif [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69add1a4-a1, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75dd7d98-739c-441a-9f21-56b67cc75915) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.compute.manager [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Rescuing
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:46 user nova-compute[75244]: INFO os_vif [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:27:05,bridge_name='br-int',has_traffic_filtering=True,id=69add1a4-a188-4454-9331-c39bffcd8b49,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69add1a4-a1')
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Deleting instance files /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b_del
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Deletion of /opt/stack/data/nova/instances/019c268b-dc0f-4e68-95e2-f26f5c24463b_del complete
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.compute.manager [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:11:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Creating image(s)
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:46 user nova-compute[75244]: DEBUG nova.policy [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6eb557daf278418793e7bb56882445f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cbbfa8e5fa4f18b3bcd03868aaab29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk 1073741824" returned: 0 in 0.051s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.213s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Cannot resize image /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Ensure instance console log exists: /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-c140f406-3c71-4fd7-a657-ce1b5765580e req-99f9a721-8e8f-40c6-9f76-05f042d7cc44 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c140f406-3c71-4fd7-a657-ce1b5765580e req-99f9a721-8e8f-40c6-9f76-05f042d7cc44 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c140f406-3c71-4fd7-a657-ce1b5765580e req-99f9a721-8e8f-40c6-9f76-05f042d7cc44 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c140f406-3c71-4fd7-a657-ce1b5765580e req-99f9a721-8e8f-40c6-9f76-05f042d7cc44 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-c140f406-3c71-4fd7-a657-ce1b5765580e req-99f9a721-8e8f-40c6-9f76-05f042d7cc44 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-c140f406-3c71-4fd7-a657-ce1b5765580e req-99f9a721-8e8f-40c6-9f76-05f042d7cc44 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-unplugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.network.neutron [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:47 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Took 1.26 seconds to deallocate network for instance.
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-05011981-652d-45d5-bfad-80d0a4bf299b req-91f3948b-6eb1-4c0b-8f65-5479ab8a6d9e service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-deleted-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:47 user nova-compute[75244]: INFO nova.compute.manager [req-05011981-652d-45d5-bfad-80d0a4bf299b req-91f3948b-6eb1-4c0b-8f65-5479ab8a6d9e service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Neutron deleted interface 69add1a4-a188-4454-9331-c39bffcd8b49; detaching it from the instance and deleting it from the info cache
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.network.neutron [req-05011981-652d-45d5-bfad-80d0a4bf299b req-91f3948b-6eb1-4c0b-8f65-5479ab8a6d9e service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-05011981-652d-45d5-bfad-80d0a4bf299b req-91f3948b-6eb1-4c0b-8f65-5479ab8a6d9e service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Detach interface failed, port_id=69add1a4-a188-4454-9331-c39bffcd8b49, reason: Instance 019c268b-dc0f-4e68-95e2-f26f5c24463b could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Successfully created port: 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:48 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Deleted allocations for instance 019c268b-dc0f-4e68-95e2-f26f5c24463b
Nov 29 23:11:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-97980352-886c-466e-b19e-3715ad15f773 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.897s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance destroyed successfully.
Nov 29 23:11:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Attempting a stable device rescue
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Successfully updated port: 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.compute.manager [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.compute.manager [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing instance network info cache due to event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75244) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:11:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Creating image(s)
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.objects.instance [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "35f085e4a97753a02f0fe47aa63a96d1e077698c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "35f085e4a97753a02f0fe47aa63a96d1e077698c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-6c172a01-67e8-4a1c-b710-7546f9fdca4e req-3d8eb6c9-3d9d-41e9-ad03-ffa435fd5515 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6c172a01-67e8-4a1c-b710-7546f9fdca4e req-3d8eb6c9-3d9d-41e9-ad03-ffa435fd5515 service nova] Acquiring lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6c172a01-67e8-4a1c-b710-7546f9fdca4e req-3d8eb6c9-3d9d-41e9-ad03-ffa435fd5515 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6c172a01-67e8-4a1c-b710-7546f9fdca4e req-3d8eb6c9-3d9d-41e9-ad03-ffa435fd5515 service nova] Lock "019c268b-dc0f-4e68-95e2-f26f5c24463b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-6c172a01-67e8-4a1c-b710-7546f9fdca4e req-3d8eb6c9-3d9d-41e9-ad03-ffa435fd5515 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] No waiting events found dispatching network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:50 user nova-compute[75244]: WARNING nova.compute.manager [req-6c172a01-67e8-4a1c-b710-7546f9fdca4e req-3d8eb6c9-3d9d-41e9-ad03-ffa435fd5515 service nova] [instance: 019c268b-dc0f-4e68-95e2-f26f5c24463b] Received unexpected event network-vif-plugged-69add1a4-a188-4454-9331-c39bffcd8b49 for instance with vm_state deleted and task_state None.
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:50 user nova-compute[75244]: WARNING nova.compute.manager [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state active and task_state rescuing.
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:50 user nova-compute[75244]: WARNING nova.compute.manager [req-e33e09f7-d699-43dd-9de6-0556b7edcd99 req-8bbcd2f9-e06d-4fe1-a47e-12a588a81ac5 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state active and task_state rescuing.
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.images [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] d82f0340-daf9-44fc-b1d3-39370e615e69 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.part /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance network_info: |[{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.network.neutron [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Start _get_guest_xml network_info=[{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:11:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1742931057',display_name='tempest-ServerStableDeviceRescueTest-server-1742931057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1742931057',id=27,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4iy9XOpg6wb+dg6ZZ/2USvuQHM/nvbg4P1hTn66BxDbA985JuwA6Q59dl4n8s39jN4tkY4GnppcNvcRJ2taMRdKZbqSsvx800GyTl8z+4LCC7vqSyh4wcQBO2HGSp+cw==',key_name='tempest-keypair-989750335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cbbfa8e5fa4f18b3bcd03868aaab29',ramdisk_id='',reservation_id='r-2wc5z6sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-564661104',owner_user_name='tempest-ServerStableDeviceRescueTest-564661104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb557daf278418793e7bb56882445f5',uuid=34b60257-6546-447b-8b6d-f95eb0fdab74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converting VIF {"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:11:50 user nova-compute[75244]:   <uuid>34b60257-6546-447b-8b6d-f95eb0fdab74</uuid>
Nov 29 23:11:50 user nova-compute[75244]:   <name>instance-0000001b</name>
Nov 29 23:11:50 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:11:50 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:11:50 user nova-compute[75244]:   <metadata>
Nov 29 23:11:50 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:11:50 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:11:50 user nova-compute[75244]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1742931057</nova:name>
Nov 29 23:11:50 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:11:50</nova:creationTime>
Nov 29 23:11:50 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:11:50 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:11:50 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:11:50 user nova-compute[75244]:       <nova:owner>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:user uuid="6eb557daf278418793e7bb56882445f5">tempest-ServerStableDeviceRescueTest-564661104-project-member</nova:user>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:project uuid="96cbbfa8e5fa4f18b3bcd03868aaab29">tempest-ServerStableDeviceRescueTest-564661104</nova:project>
Nov 29 23:11:50 user nova-compute[75244]:       </nova:owner>
Nov 29 23:11:50 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:11:50 user nova-compute[75244]:       <nova:ports>
Nov 29 23:11:50 user nova-compute[75244]:         <nova:port uuid="45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac">
Nov 29 23:11:50 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:11:50 user nova-compute[75244]:         </nova:port>
Nov 29 23:11:50 user nova-compute[75244]:       </nova:ports>
Nov 29 23:11:50 user nova-compute[75244]:     </nova:instance>
Nov 29 23:11:50 user nova-compute[75244]:   </metadata>
Nov 29 23:11:50 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:11:50 user nova-compute[75244]:     <system>
Nov 29 23:11:50 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:11:50 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:11:50 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:11:50 user nova-compute[75244]:       <entry name="serial">34b60257-6546-447b-8b6d-f95eb0fdab74</entry>
Nov 29 23:11:50 user nova-compute[75244]:       <entry name="uuid">34b60257-6546-447b-8b6d-f95eb0fdab74</entry>
Nov 29 23:11:50 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:11:50 user nova-compute[75244]:     </system>
Nov 29 23:11:50 user nova-compute[75244]:   </sysinfo>
Nov 29 23:11:50 user nova-compute[75244]:   <os>
Nov 29 23:11:50 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:11:50 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:11:50 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:11:50 user nova-compute[75244]:   </os>
Nov 29 23:11:50 user nova-compute[75244]:   <features>
Nov 29 23:11:50 user nova-compute[75244]:     <acpi/>
Nov 29 23:11:50 user nova-compute[75244]:     <apic/>
Nov 29 23:11:50 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:11:50 user nova-compute[75244]:   </features>
Nov 29 23:11:50 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:11:50 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:11:50 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:11:50 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:11:50 user nova-compute[75244]:   </clock>
Nov 29 23:11:50 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:11:50 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:11:50 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:11:50 user nova-compute[75244]:   </cpu>
Nov 29 23:11:50 user nova-compute[75244]:   <devices>
Nov 29 23:11:50 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:11:50 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:11:50 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk"/>
Nov 29 23:11:50 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:11:50 user nova-compute[75244]:     </disk>
Nov 29 23:11:50 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:11:50 user nova-compute[75244]:       <mac address="fa:16:3e:81:f3:0c"/>
Nov 29 23:11:50 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:50 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:11:50 user nova-compute[75244]:       <target dev="tap45e66a9e-17"/>
Nov 29 23:11:50 user nova-compute[75244]:     </interface>
Nov 29 23:11:50 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:11:50 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/console.log" append="off"/>
Nov 29 23:11:50 user nova-compute[75244]:     </serial>
Nov 29 23:11:50 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:11:50 user nova-compute[75244]:     <video>
Nov 29 23:11:50 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:50 user nova-compute[75244]:     </video>
Nov 29 23:11:50 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:11:50 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:11:50 user nova-compute[75244]:     </rng>
Nov 29 23:11:50 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:11:50 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:11:50 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:11:50 user nova-compute[75244]:     </memballoon>
Nov 29 23:11:50 user nova-compute[75244]:   </devices>
Nov 29 23:11:50 user nova-compute[75244]: </domain>
Nov 29 23:11:50 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1742931057',display_name='tempest-ServerStableDeviceRescueTest-server-1742931057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1742931057',id=27,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4iy9XOpg6wb+dg6ZZ/2USvuQHM/nvbg4P1hTn66BxDbA985JuwA6Q59dl4n8s39jN4tkY4GnppcNvcRJ2taMRdKZbqSsvx800GyTl8z+4LCC7vqSyh4wcQBO2HGSp+cw==',key_name='tempest-keypair-989750335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cbbfa8e5fa4f18b3bcd03868aaab29',ramdisk_id='',reservation_id='r-2wc5z6sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-564661104',owner_user_name='tempest-ServerStableDeviceRescueTest-564661104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb557daf278418793e7bb56882445f5',uuid=34b60257-6546-447b-8b6d-f95eb0fdab74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converting VIF {"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG os_vif [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e9e263a-c83a-5d9f-88b6-8e6c1599f5bb', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45e66a9e-17, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45e66a9e-17, col_values=(('qos', UUID('2c80f6ca-2f4f-4b95-babc-ee2cffa1a0ad')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45e66a9e-17, col_values=(('external_ids', {'iface-id': '45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:f3:0c', 'vm-uuid': '34b60257-6546-447b-8b6d-f95eb0fdab74'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:11:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:50 user nova-compute[75244]: INFO os_vif [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17')
Nov 29 23:11:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updated VIF entry in instance network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6dc8f2b0-02d9-4336-b55d-7f5c2392c28e req-05c1f17d-cf56-4644-ac43-b88919a593ac service nova] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No VIF found with MAC fa:16:3e:81:f3:0c, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.part /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.converted" returned: 0 in 1.125s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "35f085e4a97753a02f0fe47aa63a96d1e077698c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.655s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "35f085e4a97753a02f0fe47aa63a96d1e077698c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "35f085e4a97753a02f0fe47aa63a96d1e077698c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c,backing_fmt=raw /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c,backing_fmt=raw /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue" returned: 0 in 0.050s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "35f085e4a97753a02f0fe47aa63a96d1e077698c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'migration_context' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<9cb9953c-e973-45b7-87d4-00a4f3e74a54> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Start _get_guest_xml network_info=[{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "vif_mac": "fa:16:3e:47:3f:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd82f0340-daf9-44fc-b1d3-39370e615e69', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9cb9953c-e973-45b7-87d4-00a4f3e74a54', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa592369-87e1-4208-a285-00a92bcd9d0b', 'serial': 'aa592369-87e1-4208-a285-00a92bcd9d0b'}, 'attachment_id': '1a739e31-fa0c-454a-b8b0-93235fa3cdf5', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'resources' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<9cb9953c-e973-45b7-87d4-00a4f3e74a54> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'numa_topology' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<9cb9953c-e973-45b7-87d4-00a4f3e74a54> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<9cb9953c-e973-45b7-87d4-00a4f3e74a54> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:11:52 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:11:52 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:11:52 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0c7624-68f6-4e5b-b1a7-ce06511d7287]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FUlVfgDW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 23:11:52 user nova-compute[75244]: node.name = iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:11:52 user nova-compute[75244]: node.tpgt = -1
Nov 29 23:11:52 user nova-compute[75244]: node.startup = automatic
Nov 29 23:11:52 user nova-compute[75244]: node.leading_login = No
Nov 29 23:11:52 user nova-compute[75244]: iface.iscsi_ifacename = default
Nov 29 23:11:52 user nova-compute[75244]: iface.net_ifacename = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.ipaddress = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.prefix_len = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.hwaddress = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.transport_name = tcp
Nov 29 23:11:52 user nova-compute[75244]: iface.initiatorname = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.vlan_id = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.vlan_priority = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.vlan_state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.iface_num = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.mtu = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.port = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.bootproto = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.subnet_mask = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.gateway = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_alt_client_id = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_dns = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_learn_iqn = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_vendor_id_state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_vendor_id = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.dhcp_slp_da = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.fragmentation = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.gratuitous_arp = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.incoming_forwarding = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.tos_state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.tos = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.ttl = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.delayed_ack = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.tcp_nagle = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.tcp_wsf_state = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.tcp_wsf = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.tcp_timer_scale = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.tcp_timestamp = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.redirect = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.def_task_mgmt_timeout = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.header_digest = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.data_digest = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.immediate_data = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.initial_r2t = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.data_seq_inorder = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.data_pdu_inorder = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.erl = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.max_receive_data_len = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.first_burst_len = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.max_outstanding_r2t = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.max_burst_len = 0
Nov 29 23:11:52 user nova-compute[75244]: iface.chap_auth = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.bidi_chap = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.strict_login_compliance = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.discovery_auth = <empty>
Nov 29 23:11:52 user nova-compute[75244]: iface.discovery_logout = <empty>
Nov 29 23:11:52 user nova-compute[75244]: node.discovery_address = <empty>
Nov 29 23:11:52 user nova-compute[75244]: node.discovery_port = 0
Nov 29 23:11:52 user nova-compute[75244]: node.discovery_type = static
Nov 29 23:11:52 user nova-compute[75244]: node.session.initial_cmdsn = 0
Nov 29 23:11:52 user nova-compute[75244]: node.session.initial_login_retry_max = 8
Nov 29 23:11:52 user nova-compute[75244]: node.session.xmit_thread_priority = -20
Nov 29 23:11:52 user nova-compute[75244]: node.session.cmds_max = 128
Nov 29 23:11:52 user nova-compute[75244]: node.session.queue_depth = 32
Nov 29 23:11:52 user nova-compute[75244]: node.session.nr_sessions = 1
Nov 29 23:11:52 user nova-compute[75244]: node.session.auth.authmethod = CHAP
Nov 29 23:11:52 user nova-compute[75244]: node.session.auth.username = FUlVfgDW
Nov 29 23:11:52 user nova-compute[75244]: node.session.auth.password = ***
Nov 29 23:11:52 user nova-compute[75244]: node.session.auth.username_in = <empty>
Nov 29 23:11:52 user nova-compute[75244]: node.session.auth.password_in = <empty>
Nov 29 23:11:52 user nova-compute[75244]: node.session.auth.chap_algs = MD5
Nov 29 23:11:52 user nova-compute[75244]: node.session.timeo.replacement_timeout = 120
Nov 29 23:11:52 user nova-compute[75244]: node.session.err_timeo.abort_timeout = 15
Nov 29 23:11:52 user nova-compute[75244]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 23:11:52 user nova-compute[75244]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 23:11:52 user nova-compute[75244]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.FastAbort = Yes
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.InitialR2T = No
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.ImmediateData = Yes
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.MaxConnections = 1
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 23:11:52 user nova-compute[75244]: node.session.iscsi.ERL = 0
Nov 29 23:11:52 user nova-compute[75244]: node.session.scan = manual
Nov 29 23:11:52 user nova-compute[75244]: node.session.reopen_max = 0
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].address = 172.16.0.220
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].port = 3260
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].startup = manual
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].tcp.window_size = 524288
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].tcp.type_of_service = 0
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].timeo.logout_timeout = 15
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].timeo.login_timeout = 15
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].timeo.auth_timeout = 45
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].iscsi.DataDigest = None
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].iscsi.IFMarker = No
Nov 29 23:11:52 user nova-compute[75244]: node.conn[0].iscsi.OFMarker = No
Nov 29 23:11:52 user nova-compute[75244]: # END RECORD
Nov 29 23:11:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c80259-4d96-4dff-8bc4-f6c682a5fe5b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292f825-336a-4843-982f-5f9172ce8d21]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUlVfgDW {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUlVfgDW" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4666e9f4-233d-4a64-9945-21b8ba1c49eb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FUlVfgDW'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[579cbd72-fdda-4935-ba8f-959ffb3275d1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5933b2fc-8c24-4f0f-b2bd-1abf17841564]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:52 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:11:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:11:52 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:11:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.151s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] HCTL ('33', '0', '0', 0) found on session 27 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b08e3-6ce0-40ca-91db-e29d7b9fb659]: (4, ('0 0 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching for a device in session 27 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23539336564636237', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539336564636237', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191563974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191563974',id=24,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-65mt2o0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:10:16Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=9cb9953c-e973-45b7-87d4-00a4f3e74a54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "vif_mac": "fa:16:3e:47:3f:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "vif_mac": "fa:16:3e:47:3f:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.objects.base [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<9cb9953c-e973-45b7-87d4-00a4f3e74a54> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:11:52 user nova-compute[75244]:   <uuid>9cb9953c-e973-45b7-87d4-00a4f3e74a54</uuid>
Nov 29 23:11:52 user nova-compute[75244]:   <name>instance-00000018</name>
Nov 29 23:11:52 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:11:52 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:11:52 user nova-compute[75244]:   <metadata>
Nov 29 23:11:52 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:11:52 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:11:52 user nova-compute[75244]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-191563974</nova:name>
Nov 29 23:11:52 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:11:52</nova:creationTime>
Nov 29 23:11:52 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:11:52 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:11:52 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:11:52 user nova-compute[75244]:       <nova:owner>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:user uuid="c2a16d9d8a414de4b6621acd12b89aa0">tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member</nova:user>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:project uuid="9595b50731fc44ae85e99ded8dbbaf61">tempest-ServerBootFromVolumeStableRescueTest-1262475948</nova:project>
Nov 29 23:11:52 user nova-compute[75244]:       </nova:owner>
Nov 29 23:11:52 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:11:52 user nova-compute[75244]:       <nova:ports>
Nov 29 23:11:52 user nova-compute[75244]:         <nova:port uuid="6c2ef10b-af71-418d-854e-fa6ddf06ecf2">
Nov 29 23:11:52 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 23:11:52 user nova-compute[75244]:         </nova:port>
Nov 29 23:11:52 user nova-compute[75244]:       </nova:ports>
Nov 29 23:11:52 user nova-compute[75244]:     </nova:instance>
Nov 29 23:11:52 user nova-compute[75244]:   </metadata>
Nov 29 23:11:52 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:11:52 user nova-compute[75244]:     <system>
Nov 29 23:11:52 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:11:52 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:11:52 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:11:52 user nova-compute[75244]:       <entry name="serial">9cb9953c-e973-45b7-87d4-00a4f3e74a54</entry>
Nov 29 23:11:52 user nova-compute[75244]:       <entry name="uuid">9cb9953c-e973-45b7-87d4-00a4f3e74a54</entry>
Nov 29 23:11:52 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:11:52 user nova-compute[75244]:     </system>
Nov 29 23:11:52 user nova-compute[75244]:   </sysinfo>
Nov 29 23:11:52 user nova-compute[75244]:   <os>
Nov 29 23:11:52 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:11:52 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:11:52 user nova-compute[75244]:   </os>
Nov 29 23:11:52 user nova-compute[75244]:   <features>
Nov 29 23:11:52 user nova-compute[75244]:     <acpi/>
Nov 29 23:11:52 user nova-compute[75244]:     <apic/>
Nov 29 23:11:52 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:11:52 user nova-compute[75244]:   </features>
Nov 29 23:11:52 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:11:52 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:11:52 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:11:52 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:11:52 user nova-compute[75244]:   </clock>
Nov 29 23:11:52 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:11:52 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:11:52 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:11:52 user nova-compute[75244]:   </cpu>
Nov 29 23:11:52 user nova-compute[75244]:   <devices>
Nov 29 23:11:52 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:11:52 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:11:52 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:11:52 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:11:52 user nova-compute[75244]:       <serial>aa592369-87e1-4208-a285-00a92bcd9d0b</serial>
Nov 29 23:11:52 user nova-compute[75244]:     </disk>
Nov 29 23:11:52 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:11:52 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:11:52 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue"/>
Nov 29 23:11:52 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:11:52 user nova-compute[75244]:       <boot order="1"/>
Nov 29 23:11:52 user nova-compute[75244]:     </disk>
Nov 29 23:11:52 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:11:52 user nova-compute[75244]:       <mac address="fa:16:3e:47:3f:68"/>
Nov 29 23:11:52 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:52 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:11:52 user nova-compute[75244]:       <target dev="tap6c2ef10b-af"/>
Nov 29 23:11:52 user nova-compute[75244]:     </interface>
Nov 29 23:11:52 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:11:52 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/console.log" append="off"/>
Nov 29 23:11:52 user nova-compute[75244]:     </serial>
Nov 29 23:11:52 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:11:52 user nova-compute[75244]:     <video>
Nov 29 23:11:52 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:11:52 user nova-compute[75244]:     </video>
Nov 29 23:11:52 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:11:52 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:11:52 user nova-compute[75244]:     </rng>
Nov 29 23:11:52 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:11:52 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:11:52 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:11:52 user nova-compute[75244]:     </memballoon>
Nov 29 23:11:52 user nova-compute[75244]:   </devices>
Nov 29 23:11:52 user nova-compute[75244]: </domain>
Nov 29 23:11:52 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:11:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance destroyed successfully.
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No VIF found with MAC fa:16:3e:47:3f:68, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-7449e4c0-d68f-4e97-a57a-da8a8642342c req-f2f73e2b-1054-47e5-b472-5e73960be8de service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7449e4c0-d68f-4e97-a57a-da8a8642342c req-f2f73e2b-1054-47e5-b472-5e73960be8de service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7449e4c0-d68f-4e97-a57a-da8a8642342c req-f2f73e2b-1054-47e5-b472-5e73960be8de service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7449e4c0-d68f-4e97-a57a-da8a8642342c req-f2f73e2b-1054-47e5-b472-5e73960be8de service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-7449e4c0-d68f-4e97-a57a-da8a8642342c req-f2f73e2b-1054-47e5-b472-5e73960be8de service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:52 user nova-compute[75244]: WARNING nova.compute.manager [req-7449e4c0-d68f-4e97-a57a-da8a8642342c req-f2f73e2b-1054-47e5-b472-5e73960be8de service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state building and task_state spawning.
Nov 29 23:11:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a63eda1-82a3-4a26-95aa-003794ea8047 req-0baba1aa-0449-45d4-bc94-0ec8f3121cb3 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a63eda1-82a3-4a26-95aa-003794ea8047 req-0baba1aa-0449-45d4-bc94-0ec8f3121cb3 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a63eda1-82a3-4a26-95aa-003794ea8047 req-0baba1aa-0449-45d4-bc94-0ec8f3121cb3 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a63eda1-82a3-4a26-95aa-003794ea8047 req-0baba1aa-0449-45d4-bc94-0ec8f3121cb3 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a63eda1-82a3-4a26-95aa-003794ea8047 req-0baba1aa-0449-45d4-bc94-0ec8f3121cb3 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:54 user nova-compute[75244]: WARNING nova.compute.manager [req-1a63eda1-82a3-4a26-95aa-003794ea8047 req-0baba1aa-0449-45d4-bc94-0ec8f3121cb3 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state active and task_state rescuing.
Nov 29 23:11:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-630ecabf-7dcc-4f4f-9daa-ed845276fd47 req-343f7081-9fd2-46a8-92dd-ccd62102977b service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-630ecabf-7dcc-4f4f-9daa-ed845276fd47 req-343f7081-9fd2-46a8-92dd-ccd62102977b service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-630ecabf-7dcc-4f4f-9daa-ed845276fd47 req-343f7081-9fd2-46a8-92dd-ccd62102977b service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-630ecabf-7dcc-4f4f-9daa-ed845276fd47 req-343f7081-9fd2-46a8-92dd-ccd62102977b service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-630ecabf-7dcc-4f4f-9daa-ed845276fd47 req-343f7081-9fd2-46a8-92dd-ccd62102977b service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:55 user nova-compute[75244]: WARNING nova.compute.manager [req-630ecabf-7dcc-4f4f-9daa-ed845276fd47 req-343f7081-9fd2-46a8-92dd-ccd62102977b service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state building and task_state spawning.
Nov 29 23:11:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:11:56 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance spawned successfully.
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:11:56 user nova-compute[75244]: INFO nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Took 9.83 seconds to spawn the instance on the hypervisor.
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:11:56 user nova-compute[75244]: INFO nova.compute.manager [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Took 10.77 seconds to build instance.
Nov 29 23:11:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6594c047-dd8a-4930-89af-9f92c523effb tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.964s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-73f861ce-3c05-46a1-bfe6-9ee8a7c184f3 req-3ac4e275-859c-47f9-be5b-061384a40677 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73f861ce-3c05-46a1-bfe6-9ee8a7c184f3 req-3ac4e275-859c-47f9-be5b-061384a40677 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73f861ce-3c05-46a1-bfe6-9ee8a7c184f3 req-3ac4e275-859c-47f9-be5b-061384a40677 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73f861ce-3c05-46a1-bfe6-9ee8a7c184f3 req-3ac4e275-859c-47f9-be5b-061384a40677 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:11:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-73f861ce-3c05-46a1-bfe6-9ee8a7c184f3 req-3ac4e275-859c-47f9-be5b-061384a40677 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:11:56 user nova-compute[75244]: WARNING nova.compute.manager [req-73f861ce-3c05-46a1-bfe6-9ee8a7c184f3 req-3ac4e275-859c-47f9-be5b-061384a40677 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state active and task_state rescuing.
Nov 29 23:11:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-151b0ec5-91e1-43b4-a9aa-15eb5b9b9a2a tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:12:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:12:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:12:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:12:39 user nova-compute[75244]: INFO nova.compute.claims [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Claim successful on node user
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:12:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:12:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.policy [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aab2f432fdbf48d3bc546158221a1448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b3fc795bdd143a9bbb8b3d5a040e92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:12:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Creating image(s)
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "/opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "/opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk 1073741824" returned: 0 in 0.052s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Successfully created port: 0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.209s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Cannot resize image /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Ensure instance console log exists: /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Successfully updated port: 0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquired lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-changed-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Refreshing instance network info cache due to event network-changed-0e8c8d42-4990-43a5-9060-d4625842f795. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:12:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] Acquiring lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updating instance_info_cache with network_info: [{"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Releasing lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Instance network_info: |[{"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] Acquired lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Refreshing network info cache for port 0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Start _get_guest_xml network_info=[{"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:12:42 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:12:42 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1479901573',display_name='tempest-AttachVolumeTestJSON-server-1479901573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1479901573',id=28,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXVPqC4xPF7JZN+AX6oImGP1QsXVEzezW00Njs+2VkHC+CJfVBQG5v4wdN8lJcWKwYV+diNkoLUNipIwtHusmEtIIfDXe1JOOrV8Fgp+wqh5o7lJwkXBzbMicJ5vA01w==',key_name='tempest-keypair-438936613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-eobiqqpf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=cbf0aa1a-70a3-44c0-a6c4-0276ea375300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'pci_devices' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:12:42 user nova-compute[75244]:   <uuid>cbf0aa1a-70a3-44c0-a6c4-0276ea375300</uuid>
Nov 29 23:12:42 user nova-compute[75244]:   <name>instance-0000001c</name>
Nov 29 23:12:42 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:12:42 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:12:42 user nova-compute[75244]:   <metadata>
Nov 29 23:12:42 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:12:42 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:12:42 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeTestJSON-server-1479901573</nova:name>
Nov 29 23:12:42 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:12:42</nova:creationTime>
Nov 29 23:12:42 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:12:42 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:12:42 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:12:42 user nova-compute[75244]:       <nova:owner>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:user uuid="aab2f432fdbf48d3bc546158221a1448">tempest-AttachVolumeTestJSON-2123642001-project-member</nova:user>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:project uuid="8b3fc795bdd143a9bbb8b3d5a040e92f">tempest-AttachVolumeTestJSON-2123642001</nova:project>
Nov 29 23:12:42 user nova-compute[75244]:       </nova:owner>
Nov 29 23:12:42 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:12:42 user nova-compute[75244]:       <nova:ports>
Nov 29 23:12:42 user nova-compute[75244]:         <nova:port uuid="0e8c8d42-4990-43a5-9060-d4625842f795">
Nov 29 23:12:42 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 23:12:42 user nova-compute[75244]:         </nova:port>
Nov 29 23:12:42 user nova-compute[75244]:       </nova:ports>
Nov 29 23:12:42 user nova-compute[75244]:     </nova:instance>
Nov 29 23:12:42 user nova-compute[75244]:   </metadata>
Nov 29 23:12:42 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:12:42 user nova-compute[75244]:     <system>
Nov 29 23:12:42 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:12:42 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:12:42 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:12:42 user nova-compute[75244]:       <entry name="serial">cbf0aa1a-70a3-44c0-a6c4-0276ea375300</entry>
Nov 29 23:12:42 user nova-compute[75244]:       <entry name="uuid">cbf0aa1a-70a3-44c0-a6c4-0276ea375300</entry>
Nov 29 23:12:42 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:12:42 user nova-compute[75244]:     </system>
Nov 29 23:12:42 user nova-compute[75244]:   </sysinfo>
Nov 29 23:12:42 user nova-compute[75244]:   <os>
Nov 29 23:12:42 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:12:42 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:12:42 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:12:42 user nova-compute[75244]:   </os>
Nov 29 23:12:42 user nova-compute[75244]:   <features>
Nov 29 23:12:42 user nova-compute[75244]:     <acpi/>
Nov 29 23:12:42 user nova-compute[75244]:     <apic/>
Nov 29 23:12:42 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:12:42 user nova-compute[75244]:   </features>
Nov 29 23:12:42 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:12:42 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:12:42 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:12:42 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:12:42 user nova-compute[75244]:   </clock>
Nov 29 23:12:42 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:12:42 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:12:42 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:12:42 user nova-compute[75244]:   </cpu>
Nov 29 23:12:42 user nova-compute[75244]:   <devices>
Nov 29 23:12:42 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:12:42 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:12:42 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk"/>
Nov 29 23:12:42 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:12:42 user nova-compute[75244]:     </disk>
Nov 29 23:12:42 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:12:42 user nova-compute[75244]:       <mac address="fa:16:3e:38:e3:92"/>
Nov 29 23:12:42 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:12:42 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:12:42 user nova-compute[75244]:       <target dev="tap0e8c8d42-49"/>
Nov 29 23:12:42 user nova-compute[75244]:     </interface>
Nov 29 23:12:42 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:12:42 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/console.log" append="off"/>
Nov 29 23:12:42 user nova-compute[75244]:     </serial>
Nov 29 23:12:42 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:12:42 user nova-compute[75244]:     <video>
Nov 29 23:12:42 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:12:42 user nova-compute[75244]:     </video>
Nov 29 23:12:42 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:12:42 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:12:42 user nova-compute[75244]:     </rng>
Nov 29 23:12:42 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:12:42 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:12:42 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:12:42 user nova-compute[75244]:     </memballoon>
Nov 29 23:12:42 user nova-compute[75244]:   </devices>
Nov 29 23:12:42 user nova-compute[75244]: </domain>
Nov 29 23:12:42 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1479901573',display_name='tempest-AttachVolumeTestJSON-server-1479901573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1479901573',id=28,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXVPqC4xPF7JZN+AX6oImGP1QsXVEzezW00Njs+2VkHC+CJfVBQG5v4wdN8lJcWKwYV+diNkoLUNipIwtHusmEtIIfDXe1JOOrV8Fgp+wqh5o7lJwkXBzbMicJ5vA01w==',key_name='tempest-keypair-438936613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-eobiqqpf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=cbf0aa1a-70a3-44c0-a6c4-0276ea375300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG os_vif [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68b453bb-e453-5736-9451-914c412e21e5', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e8c8d42-49, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e8c8d42-49, col_values=(('qos', UUID('1430433e-5ee0-426b-9592-567c9358bf48')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e8c8d42-49, col_values=(('external_ids', {'iface-id': '0e8c8d42-4990-43a5-9060-d4625842f795', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e3:92', 'vm-uuid': 'cbf0aa1a-70a3-44c0-a6c4-0276ea375300'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:42 user nova-compute[75244]: INFO os_vif [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49')
Nov 29 23:12:42 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:12:42 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7786MB free_disk=25.088733673095703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No VIF found with MAC fa:16:3e:38:e3:92, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5eadf8f0-a801-47b5-99d8-34812a0d83db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updated VIF entry in instance network info cache for port 0e8c8d42-4990-43a5-9060-d4625842f795. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:12:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updating instance_info_cache with network_info: [{"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5759f0f0-38df-470c-970f-f9e35b24784b req-68d639c6-d867-41b6-869b-303d968d39f0 service nova] Releasing lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-6683bc77-7bc0-4620-a0b5-d1a01e9b3d4d req-baa0cc0e-7978-4ff2-950f-d6e14158ccf4 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6683bc77-7bc0-4620-a0b5-d1a01e9b3d4d req-baa0cc0e-7978-4ff2-950f-d6e14158ccf4 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6683bc77-7bc0-4620-a0b5-d1a01e9b3d4d req-baa0cc0e-7978-4ff2-950f-d6e14158ccf4 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6683bc77-7bc0-4620-a0b5-d1a01e9b3d4d req-baa0cc0e-7978-4ff2-950f-d6e14158ccf4 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-6683bc77-7bc0-4620-a0b5-d1a01e9b3d4d req-baa0cc0e-7978-4ff2-950f-d6e14158ccf4 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:12:44 user nova-compute[75244]: WARNING nova.compute.manager [req-6683bc77-7bc0-4620-a0b5-d1a01e9b3d4d req-baa0cc0e-7978-4ff2-950f-d6e14158ccf4 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received unexpected event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with vm_state building and task_state spawning.
Nov 29 23:12:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:12:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:12:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Instance spawned successfully.
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:12:46 user nova-compute[75244]: INFO nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-d4d0c3e0-5089-4234-8781-a864612eeabc req-fada2df6-89a6-4c3f-b8cf-59cb0e051911 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d4d0c3e0-5089-4234-8781-a864612eeabc req-fada2df6-89a6-4c3f-b8cf-59cb0e051911 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d4d0c3e0-5089-4234-8781-a864612eeabc req-fada2df6-89a6-4c3f-b8cf-59cb0e051911 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d4d0c3e0-5089-4234-8781-a864612eeabc req-fada2df6-89a6-4c3f-b8cf-59cb0e051911 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-d4d0c3e0-5089-4234-8781-a864612eeabc req-fada2df6-89a6-4c3f-b8cf-59cb0e051911 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:12:46 user nova-compute[75244]: WARNING nova.compute.manager [req-d4d0c3e0-5089-4234-8781-a864612eeabc req-fada2df6-89a6-4c3f-b8cf-59cb0e051911 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received unexpected event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with vm_state building and task_state spawning.
Nov 29 23:12:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:46 user nova-compute[75244]: INFO nova.compute.manager [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Took 6.58 seconds to build instance.
Nov 29 23:12:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6778cf26-40ef-4e17-a47e-5ced67e90b34 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:12:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-changed-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Refreshing instance network info cache due to event network-changed-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:12:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Refreshing network info cache for port b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG nova.objects.instance [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'flavor' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:12:58 user nova-compute[75244]: INFO nova.compute.manager [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Attaching volume ed984e2b-1b00-4864-80a3-22b6d3092a3c to /dev/vdb
Nov 29 23:12:58 user nova-compute[75244]: DEBUG os_brick.utils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1af9706-f274-4745-8f5f-7be163666a99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94cb7ae-64ff-44f4-837c-84c9d09a726d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abff31a-d3f3-4c7a-8b21-bf4a3f839243]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf984d5-41aa-4244-b915-fd0c75dbd96d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:12:58 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e16fccf-1eea-438b-93b0-1940ad102b7f]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG os_brick.utils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating existing volume attachment record: 4619b0c9-305b-49a2-bb8a-fecefbd36c8b {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated VIF entry in instance network info cache for port b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG nova.network.neutron [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:12:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-808a9d80-b0b7-4bc1-adec-a43e61d1dff8 req-8c79b4b1-01e6-48d6-8bbe-2cf60bf77e56 service nova] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:02 user nova-compute[75244]: INFO nova.compute.manager [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Unshelving
Nov 29 23:13:02 user nova-compute[75244]: INFO nova.virt.block_device [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Booting with volume 8cf0e830-0613-46a9-badd-bca0a18cd8af at /dev/vda
Nov 29 23:13:02 user nova-compute[75244]: DEBUG os_brick.utils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[731e2911-62e0-471d-9cff-a89d0412aaa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761310e-ee62-479d-9f62-699693d754fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b9a1f0-0026-4a3e-915c-fe8ccebc969a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[72536ca2-5237-49b2-a73d-346c852576ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:13:03 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:13:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[920313cf-4cab-420a-944a-d41248d3c4e3]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG os_brick.utils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating existing volume attachment record: 0f455f7d-878f-4a03-bf20-1f1d562ff1ea {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:03 user nova-compute[75244]: INFO nova.compute.manager [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Unshelving
Nov 29 23:13:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'pci_requests' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'numa_topology' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:13:04 user nova-compute[75244]: INFO nova.compute.claims [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Claim successful on node user
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:13:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:04 user nova-compute[75244]: INFO nova.network.neutron [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating port e96d8f49-a385-4553-805a-a353f62944ac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-changed-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing instance network info cache due to event network-changed-e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] Acquiring lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:13:05 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Creating image(s)
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] Acquired lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Refreshing network info cache for port e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG nova.objects.base [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<24054fdc-8f5e-4352-bdfa-717f288152bf> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "6a528e58c01512f303f30038594cce95d9891227" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "6a528e58c01512f303f30038594cce95d9891227" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:06 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:06 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:06 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced80cf-5fb4-493f-9119-0d82b232f210]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:13:06 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[40903917-96c6-4d3c-a26d-0514f017ed25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c] added
Nov 29 23:13:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890c313-b189-414e-a72e-84068d113cb7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be035ca-8046-47bb-b209-edaebc2cbf0e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQwCaIxg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG nova.virt.images [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] f08acb67-db00-43c7-ba3a-f197daf5683c was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.part /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQwCaIxg" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa055234-24c3-4feb-bc9f-ce79b364011d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQwCaIxg'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44e857-5ea1-4048-8520-d4e602925a7c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3fa0e-674f-415e-8a9e-083f9ce0b745]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:07 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:07 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updated VIF entry in instance network info cache for port e96d8f49-a385-4553-805a-a353f62944ac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG nova.network.neutron [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26fb75-38e9-4cbd-8089-944ab0cec4f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]
Nov 29 23:13:07 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6443d164-1bbb-4b9a-a43e-64ccd8930256 req-b0eecd5d-1727-4420-b279-d13a0d8ab1e2 service nova] Releasing lock "refresh_cache-24054fdc-8f5e-4352-bdfa-717f288152bf" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2bf15-d518-4f28-a165-ed47c750013f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.part /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.converted" returned: 0 in 0.256s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bed7c32-5f99-44ee-9bf3-8b4d1197bee0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:07 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:07 user nova-compute[75244]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:07 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:07 user nova-compute[75244]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42afdbb-2c70-47f5-a808-55c99ccf2d70]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "6a528e58c01512f303f30038594cce95d9891227" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.512s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "6a528e58c01512f303f30038594cce95d9891227" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "6a528e58c01512f303f30038594cce95d9891227" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227,backing_fmt=raw /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227,backing_fmt=raw /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk 1073741824" returned: 0 in 0.053s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "6a528e58c01512f303f30038594cce95d9891227" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 --force-share --output=json" returned: 0 in 0.220s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'migration_context' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.objects.base [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<24054fdc-8f5e-4352-bdfa-717f288152bf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:13:08 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Rebasing disk image.
Nov 29 23:13:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 -F raw /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '26333363139636234', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363139636234', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.objects.instance [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'flavor' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:13:08 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:08 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:13:08 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:13:08 user nova-compute[75244]:   <serial>ed984e2b-1b00-4864-80a3-22b6d3092a3c</serial>
Nov 29 23:13:08 user nova-compute[75244]: </disk>
Nov 29 23:13:08 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No VIF found with MAC fa:16:3e:79:3f:62, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:13:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-579e273b-2841-40e8-95f2-28e96fc8baaa tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.613s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 -F raw /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk" returned: 0 in 2.131s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Ensure instance console log exists: /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Start _get_guest_xml network_info=[{"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='65289b7cd4eba606302c581c995e0e97',container_format='bare',created_at=2023-11-29T23:11:11Z,direct_url=<?>,disk_format='qcow2',id=f08acb67-db00-43c7-ba3a-f197daf5683c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1486852029-shelved',owner='b273a67b0a2f462aa1092779f31fdc8a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T23:11:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:13:10 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:10 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='65289b7cd4eba606302c581c995e0e97',container_format='bare',created_at=2023-11-29T23:11:11Z,direct_url=<?>,disk_format='qcow2',id=f08acb67-db00-43c7-ba3a-f197daf5683c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1486852029-shelved',owner='b273a67b0a2f462aa1092779f31fdc8a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T23:11:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.objects.base [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<24054fdc-8f5e-4352-bdfa-717f288152bf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486852029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486852029',id=22,image_ref='f08acb67-db00-43c7-ba3a-f197daf5683c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-17102318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-d87zlrs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member',shelved_at='2023-11-29T23:11:15.824698',shelved_host='user',shelved_image_id='f08acb67-db00-43c7-ba3a-f197daf5683c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=24054fdc-8f5e-4352-bdfa-717f288152bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'pci_devices' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.objects.base [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Object Instance<24054fdc-8f5e-4352-bdfa-717f288152bf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:13:10 user nova-compute[75244]:   <uuid>24054fdc-8f5e-4352-bdfa-717f288152bf</uuid>
Nov 29 23:13:10 user nova-compute[75244]:   <name>instance-00000016</name>
Nov 29 23:13:10 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:13:10 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:13:10 user nova-compute[75244]:   <metadata>
Nov 29 23:13:10 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:13:10 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:13:10 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1486852029</nova:name>
Nov 29 23:13:10 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:13:10</nova:creationTime>
Nov 29 23:13:10 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:13:10 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:13:10 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:13:10 user nova-compute[75244]:       <nova:owner>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:user uuid="fe39bc0caf6f49368d0d0cb0789a1d3c">tempest-AttachVolumeShelveTestJSON-576906296-project-member</nova:user>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:project uuid="b273a67b0a2f462aa1092779f31fdc8a">tempest-AttachVolumeShelveTestJSON-576906296</nova:project>
Nov 29 23:13:10 user nova-compute[75244]:       </nova:owner>
Nov 29 23:13:10 user nova-compute[75244]:       <nova:root type="image" uuid="f08acb67-db00-43c7-ba3a-f197daf5683c"/>
Nov 29 23:13:10 user nova-compute[75244]:       <nova:ports>
Nov 29 23:13:10 user nova-compute[75244]:         <nova:port uuid="e96d8f49-a385-4553-805a-a353f62944ac">
Nov 29 23:13:10 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 23:13:10 user nova-compute[75244]:         </nova:port>
Nov 29 23:13:10 user nova-compute[75244]:       </nova:ports>
Nov 29 23:13:10 user nova-compute[75244]:     </nova:instance>
Nov 29 23:13:10 user nova-compute[75244]:   </metadata>
Nov 29 23:13:10 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:13:10 user nova-compute[75244]:     <system>
Nov 29 23:13:10 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:13:10 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:13:10 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:13:10 user nova-compute[75244]:       <entry name="serial">24054fdc-8f5e-4352-bdfa-717f288152bf</entry>
Nov 29 23:13:10 user nova-compute[75244]:       <entry name="uuid">24054fdc-8f5e-4352-bdfa-717f288152bf</entry>
Nov 29 23:13:10 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:13:10 user nova-compute[75244]:     </system>
Nov 29 23:13:10 user nova-compute[75244]:   </sysinfo>
Nov 29 23:13:10 user nova-compute[75244]:   <os>
Nov 29 23:13:10 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:13:10 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:13:10 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:13:10 user nova-compute[75244]:   </os>
Nov 29 23:13:10 user nova-compute[75244]:   <features>
Nov 29 23:13:10 user nova-compute[75244]:     <acpi/>
Nov 29 23:13:10 user nova-compute[75244]:     <apic/>
Nov 29 23:13:10 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:13:10 user nova-compute[75244]:   </features>
Nov 29 23:13:10 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:13:10 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:13:10 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:13:10 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:13:10 user nova-compute[75244]:   </clock>
Nov 29 23:13:10 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:13:10 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:13:10 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:13:10 user nova-compute[75244]:   </cpu>
Nov 29 23:13:10 user nova-compute[75244]:   <devices>
Nov 29 23:13:10 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:13:10 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:13:10 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk"/>
Nov 29 23:13:10 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:13:10 user nova-compute[75244]:     </disk>
Nov 29 23:13:10 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:13:10 user nova-compute[75244]:       <mac address="fa:16:3e:e0:63:10"/>
Nov 29 23:13:10 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:13:10 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:13:10 user nova-compute[75244]:       <target dev="tape96d8f49-a3"/>
Nov 29 23:13:10 user nova-compute[75244]:     </interface>
Nov 29 23:13:10 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:13:10 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/console.log" append="off"/>
Nov 29 23:13:10 user nova-compute[75244]:     </serial>
Nov 29 23:13:10 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:13:10 user nova-compute[75244]:     <video>
Nov 29 23:13:10 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:13:10 user nova-compute[75244]:     </video>
Nov 29 23:13:10 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:13:10 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:13:10 user nova-compute[75244]:     </rng>
Nov 29 23:13:10 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:13:10 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:13:10 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:13:10 user nova-compute[75244]:     </memballoon>
Nov 29 23:13:10 user nova-compute[75244]:   </devices>
Nov 29 23:13:10 user nova-compute[75244]: </domain>
Nov 29 23:13:10 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486852029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486852029',id=22,image_ref='f08acb67-db00-43c7-ba3a-f197daf5683c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-17102318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-d87zlrs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member',shelved_at='2023-11-29T23:11:15.824698',shelved_host='user',shelved_image_id='f08acb67-db00-43c7-ba3a-f197daf5683c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=24054fdc-8f5e-4352-bdfa-717f288152bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG os_vif [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba0ca094-dd26-5d45-8aef-dbcd4cddf892', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape96d8f49-a3, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape96d8f49-a3, col_values=(('qos', UUID('b247258f-f053-4bfb-8ab8-904f9d4b1979')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape96d8f49-a3, col_values=(('external_ids', {'iface-id': 'e96d8f49-a385-4553-805a-a353f62944ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:63:10', 'vm-uuid': '24054fdc-8f5e-4352-bdfa-717f288152bf'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:10 user nova-compute[75244]: INFO os_vif [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3')
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] No VIF found with MAC fa:16:3e:e0:63:10, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:13:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Stashing vm_state: active {{(pid=75244) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:13:11 user nova-compute[75244]: INFO nova.compute.claims [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Claim successful on node user
Nov 29 23:13:11 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating resource usage from migration c5765990-1530-4271-90e1-a87af20101e3
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.541s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:11 user nova-compute[75244]: INFO nova.compute.manager [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Migrating
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:11 user nova-compute[75244]: INFO nova.compute.rpcapi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'pci_requests' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'numa_topology' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:13:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:13:11 user nova-compute[75244]: INFO nova.compute.claims [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Claim successful on node user
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-1d06cee6-cbd8-462b-b4bf-0af70fc59ba0 req-5e0c5a4f-2456-4334-854a-a2406a5f63f9 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d06cee6-cbd8-462b-b4bf-0af70fc59ba0 req-5e0c5a4f-2456-4334-854a-a2406a5f63f9 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d06cee6-cbd8-462b-b4bf-0af70fc59ba0 req-5e0c5a4f-2456-4334-854a-a2406a5f63f9 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1d06cee6-cbd8-462b-b4bf-0af70fc59ba0 req-5e0c5a4f-2456-4334-854a-a2406a5f63f9 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-1d06cee6-cbd8-462b-b4bf-0af70fc59ba0 req-5e0c5a4f-2456-4334-854a-a2406a5f63f9 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:12 user nova-compute[75244]: WARNING nova.compute.manager [req-1d06cee6-cbd8-462b-b4bf-0af70fc59ba0 req-5e0c5a4f-2456-4334-854a-a2406a5f63f9 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:12 user nova-compute[75244]: INFO nova.network.neutron [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating port cb3b5745-668b-43f3-a685-d55bbd873b3e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Starting migrate_disk_and_power_off {{(pid=75244) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-1943aa62-53cb-424a-a71f-cd104ead5d20 req-be188811-4c3d-4534-ad5f-168ba79e063b service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1943aa62-53cb-424a-a71f-cd104ead5d20 req-be188811-4c3d-4534-ad5f-168ba79e063b service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1943aa62-53cb-424a-a71f-cd104ead5d20 req-be188811-4c3d-4534-ad5f-168ba79e063b service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1943aa62-53cb-424a-a71f-cd104ead5d20 req-be188811-4c3d-4534-ad5f-168ba79e063b service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-1943aa62-53cb-424a-a71f-cd104ead5d20 req-be188811-4c3d-4534-ad5f-168ba79e063b service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:12 user nova-compute[75244]: WARNING nova.compute.manager [req-1943aa62-53cb-424a-a71f-cd104ead5d20 req-be188811-4c3d-4534-ad5f-168ba79e063b service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state active and task_state resize_migrating.
Nov 29 23:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing instance network info cache due to event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance destroyed successfully.
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeb2df2b-51, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f90119b-e02b-458b-a157-2ea4f80910cd) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:13:13 user nova-compute[75244]: INFO os_vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51')
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[63abf02c-9fa6-4888-82cb-9132cb2b1a33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:13:13 user nova-compute[75244]: No targets found.
Nov 29 23:13:13 user nova-compute[75244]: iSNS:
Nov 29 23:13:13 user nova-compute[75244]: No targets found.
Nov 29 23:13:13 user nova-compute[75244]: STATIC:
Nov 29 23:13:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e
Nov 29 23:13:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:13:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:13:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:13 user nova-compute[75244]: FIRMWARE:
Nov 29 23:13:13 user nova-compute[75244]: No targets found.
Nov 29 23:13:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:13:13 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:13:13 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae82342-fcd9-4d64-b3af-4e0e43b16504]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d026aa-82a2-4dc4-965e-1060f2f7e05a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:13 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:13 user nova-compute[75244]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:13 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:13 user nova-compute[75244]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c1abd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0fd45d-5845-4ecc-8e56-b801c01c8905]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[88104198-e445-43b6-ad9b-dac6b97f0b18]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa14ca-abce-4300-bd2c-e95c5964a468]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6d784-1d27-47ea-91ea-6030a47eac70]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7e982-b01a-44d3-aaec-dccf3d4c20cc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[905655d8-8b77-48fd-bd7c-a2ab45c25e42]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]
Nov 29 23:13:13 user nova-compute[75244]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3692a-cfde-433f-b16f-c3a34402eaea]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== disconnect_volume: return (310ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:13:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Creating image(s)
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Ensure instance console log exists: /opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Start _get_guest_xml network_info=[{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '089b181a-b746-4a25-94ad-50fd268a7cd9', 'attached_at': '', 'detached_at': '', 'volume_id': '8cf0e830-0613-46a9-badd-bca0a18cd8af', 'serial': '8cf0e830-0613-46a9-badd-bca0a18cd8af'}, 'attachment_id': '0f455f7d-878f-4a03-bf20-1f1d562ff1ea', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:13:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'vcpu_model' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:13 user nova-compute[75244]: DEBUG nova.objects.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Object Instance<089b181a-b746-4a25-94ad-50fd268a7cd9> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:14 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afdfc30-f85c-4e75-bd1b-b46a96e5342b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:13:14 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393be5c-0e26-465a-a4c1-da111be9b20c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af] added
Nov 29 23:13:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e064e3-8a7f-4829-abc3-53f23f54fc1d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[939a48f8-29ae-436e-9ee5-ea823a84b452]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMwJnuRL {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4_resize/disk /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMwJnuRL" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9843eb40-5574-43e3-9615-d9506700307b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMwJnuRL'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4833fd84-f315-47a0-96e5-ee876dcc9744]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d293fe5e-35ce-4489-bf9b-3abf02338b98]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:14 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:14 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa8b47e-1b36-4c17-870c-3ad9c8582298]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]
Nov 29 23:13:14 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1570a87-d88f-417d-bfe3-9191efabea41]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9bf453-de95-49bd-a5bf-8d134045d5b4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:14 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:14 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:14 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:14 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:14 user nova-compute[75244]: WARNING nova.compute.manager [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-changed-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing instance network info cache due to event network-changed-17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee38ee-4525-4650-9abd-27666730e537]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "cp -r /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4_resize/disk /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk" returned: 0 in 0.302s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4_resize/disk.info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk.info {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "cp -r /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4_resize/disk.info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk.info" returned: 0 in 0.038s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:13:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance spawned successfully.
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updated VIF entry in instance network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d6697f45-2caf-45a3-8b7e-b9a91d6c03ef req-76ae9729-f4c2-4775-946a-89ddf921a2a6 service nova] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:14 user nova-compute[75244]: INFO nova.compute.manager [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Detaching volume 5348d649-9d67-419b-9f9b-cb4d6265201e
Nov 29 23:13:14 user nova-compute[75244]: INFO nova.virt.block_device [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Attempting to driver detach volume 5348d649-9d67-419b-9f9b-cb4d6265201e from mountpoint /dev/vdb
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Attempting to detach device vdb from instance 5eadf8f0-a801-47b5-99d8-34812a0d83db from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:13:14 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:14 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:13:14 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:13:14 user nova-compute[75244]:   <serial>5348d649-9d67-419b-9f9b-cb4d6265201e</serial>
Nov 29 23:13:14 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:13:14 user nova-compute[75244]: </disk>
Nov 29 23:13:14 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:13:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully detached device vdb from instance 5eadf8f0-a801-47b5-99d8-34812a0d83db from the persistent domain config.
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5eadf8f0-a801-47b5-99d8-34812a0d83db from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:13:14 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:14 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:13:14 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:13:14 user nova-compute[75244]:   <serial>5348d649-9d67-419b-9f9b-cb4d6265201e</serial>
Nov 29 23:13:14 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:13:14 user nova-compute[75244]: </disk>
Nov 29 23:13:14 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updated VIF entry in instance network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cd931c12-95e4-43f8-84dd-93b8693c3d3c tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.209s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d2a958ed-8229-4c30-ad76-5121c5c59ae6 req-c5e727f1-8b28-4bfc-b6fa-b7d02ba7a4d5 service nova] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:15 user nova-compute[75244]: WARNING nova.compute.manager [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state active and task_state resize_migrating.
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-changed-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing instance network info cache due to event network-changed-17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] Acquiring lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] Acquired lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Refreshing network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5eadf8f0-a801-47b5-99d8-34812a0d83db {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23637343662373333', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637343662373333', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2123477696',display_name='tempest-TestShelveInstance-server-2123477696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2123477696',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-888719108',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c0258ba7ccde40a09e3e251fbef77431',ramdisk_id='',reservation_id='r-i514jhss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1542675207',owner_user_name='tempest-TestShelveInstance-1542675207-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:13:03Z,user_data=None,user_id='476af5a1d41146788ce60db8a2683f23',uuid=089b181a-b746-4a25-94ad-50fd268a7cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converting VIF {"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'pci_devices' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updated VIF entry in instance network info cache for port 17d779a7-8523-4a82-a9da-534db4d80939. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [{"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.objects.base [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Object Instance<089b181a-b746-4a25-94ad-50fd268a7cd9> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:13:15 user nova-compute[75244]:   <uuid>089b181a-b746-4a25-94ad-50fd268a7cd9</uuid>
Nov 29 23:13:15 user nova-compute[75244]:   <name>instance-00000017</name>
Nov 29 23:13:15 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:13:15 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:13:15 user nova-compute[75244]:   <metadata>
Nov 29 23:13:15 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:13:15 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:13:15 user nova-compute[75244]:       <nova:name>tempest-TestShelveInstance-server-2123477696</nova:name>
Nov 29 23:13:15 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:13:13</nova:creationTime>
Nov 29 23:13:15 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:13:15 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:13:15 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:13:15 user nova-compute[75244]:       <nova:owner>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:user uuid="476af5a1d41146788ce60db8a2683f23">tempest-TestShelveInstance-1542675207-project-member</nova:user>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:project uuid="c0258ba7ccde40a09e3e251fbef77431">tempest-TestShelveInstance-1542675207</nova:project>
Nov 29 23:13:15 user nova-compute[75244]:       </nova:owner>
Nov 29 23:13:15 user nova-compute[75244]:       <nova:ports>
Nov 29 23:13:15 user nova-compute[75244]:         <nova:port uuid="cb3b5745-668b-43f3-a685-d55bbd873b3e">
Nov 29 23:13:15 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:13:15 user nova-compute[75244]:         </nova:port>
Nov 29 23:13:15 user nova-compute[75244]:       </nova:ports>
Nov 29 23:13:15 user nova-compute[75244]:     </nova:instance>
Nov 29 23:13:15 user nova-compute[75244]:   </metadata>
Nov 29 23:13:15 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:13:15 user nova-compute[75244]:     <system>
Nov 29 23:13:15 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:13:15 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:13:15 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:13:15 user nova-compute[75244]:       <entry name="serial">089b181a-b746-4a25-94ad-50fd268a7cd9</entry>
Nov 29 23:13:15 user nova-compute[75244]:       <entry name="uuid">089b181a-b746-4a25-94ad-50fd268a7cd9</entry>
Nov 29 23:13:15 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:13:15 user nova-compute[75244]:     </system>
Nov 29 23:13:15 user nova-compute[75244]:   </sysinfo>
Nov 29 23:13:15 user nova-compute[75244]:   <os>
Nov 29 23:13:15 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:13:15 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:13:15 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:13:15 user nova-compute[75244]:   </os>
Nov 29 23:13:15 user nova-compute[75244]:   <features>
Nov 29 23:13:15 user nova-compute[75244]:     <acpi/>
Nov 29 23:13:15 user nova-compute[75244]:     <apic/>
Nov 29 23:13:15 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:13:15 user nova-compute[75244]:   </features>
Nov 29 23:13:15 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:13:15 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:13:15 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:13:15 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:13:15 user nova-compute[75244]:   </clock>
Nov 29 23:13:15 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:13:15 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:13:15 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:13:15 user nova-compute[75244]:   </cpu>
Nov 29 23:13:15 user nova-compute[75244]:   <devices>
Nov 29 23:13:15 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:13:15 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:15 user nova-compute[75244]:       <source dev="/dev/sdd"/>
Nov 29 23:13:15 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:13:15 user nova-compute[75244]:       <serial>8cf0e830-0613-46a9-badd-bca0a18cd8af</serial>
Nov 29 23:13:15 user nova-compute[75244]:     </disk>
Nov 29 23:13:15 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:13:15 user nova-compute[75244]:       <mac address="fa:16:3e:23:77:dc"/>
Nov 29 23:13:15 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:13:15 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:13:15 user nova-compute[75244]:       <target dev="tapcb3b5745-66"/>
Nov 29 23:13:15 user nova-compute[75244]:     </interface>
Nov 29 23:13:15 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:13:15 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9/console.log" append="off"/>
Nov 29 23:13:15 user nova-compute[75244]:     </serial>
Nov 29 23:13:15 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:13:15 user nova-compute[75244]:     <video>
Nov 29 23:13:15 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:13:15 user nova-compute[75244]:     </video>
Nov 29 23:13:15 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:13:15 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:13:15 user nova-compute[75244]:     </rng>
Nov 29 23:13:15 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:13:15 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:13:15 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:13:15 user nova-compute[75244]:     </memballoon>
Nov 29 23:13:15 user nova-compute[75244]:   </devices>
Nov 29 23:13:15 user nova-compute[75244]: </domain>
Nov 29 23:13:15 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2123477696',display_name='tempest-TestShelveInstance-server-2123477696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2123477696',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-888719108',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c0258ba7ccde40a09e3e251fbef77431',ramdisk_id='',reservation_id='r-i514jhss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1542675207',owner_user_name='tempest-TestShelveInstance-1542675207-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:13:03Z,user_data=None,user_id='476af5a1d41146788ce60db8a2683f23',uuid=089b181a-b746-4a25-94ad-50fd268a7cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converting VIF {"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG os_vif [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa953d62-c339-5449-99a4-aa35619cfd70', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7acdcdf8-e31c-4aab-9cb1-b7f6b8b15951 req-1ed1d448-2bde-4549-b0e0-be85f39ba3c1 service nova] Releasing lock "refresh_cache-5eadf8f0-a801-47b5-99d8-34812a0d83db" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb3b5745-66, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb3b5745-66, col_values=(('qos', UUID('2e297619-86cc-4227-b102-0827fbb7d3f5')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb3b5745-66, col_values=(('external_ids', {'iface-id': 'cb3b5745-668b-43f3-a685-d55bbd873b3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:77:dc', 'vm-uuid': '089b181a-b746-4a25-94ad-50fd268a7cd9'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:15 user nova-compute[75244]: INFO os_vif [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66')
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] No VIF found with MAC fa:16:3e:23:77:dc, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Port beb2df2b-5192-4d17-8e62-09c480ce6e36 binding to destination host user is already ACTIVE {{(pid=75244) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG os_brick.utils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa52276-11a8-4233-8267-3be6ad006fa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa81ef-9df0-4214-b974-541cb2dd16c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef59f5-f410-42eb-8f42-fffc59201e0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbe6dea-938d-4c64-b7a8-2d06580f71b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:13:16 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:13:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c05202c-1e38-4d51-96fa-d55a1765ea39]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG os_brick.utils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-d79118f3-35ec-4263-ae24-880e7c3d6583 req-2c97a9c6-d73f-4d0c-9994-60c5498f257f service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d79118f3-35ec-4263-ae24-880e7c3d6583 req-2c97a9c6-d73f-4d0c-9994-60c5498f257f service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d79118f3-35ec-4263-ae24-880e7c3d6583 req-2c97a9c6-d73f-4d0c-9994-60c5498f257f service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d79118f3-35ec-4263-ae24-880e7c3d6583 req-2c97a9c6-d73f-4d0c-9994-60c5498f257f service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-d79118f3-35ec-4263-ae24-880e7c3d6583 req-2c97a9c6-d73f-4d0c-9994-60c5498f257f service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:17 user nova-compute[75244]: WARNING nova.compute.manager [req-d79118f3-35ec-4263-ae24-880e7c3d6583 req-2c97a9c6-d73f-4d0c-9994-60c5498f257f service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 23:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:13:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance spawned successfully.
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-12b839c8-ab90-4248-8f8d-edd1b6dfa6ce req-a54178bc-e140-4f5e-ac1d-723f59efd96d service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-12b839c8-ab90-4248-8f8d-edd1b6dfa6ce req-a54178bc-e140-4f5e-ac1d-723f59efd96d service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-12b839c8-ab90-4248-8f8d-edd1b6dfa6ce req-a54178bc-e140-4f5e-ac1d-723f59efd96d service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-12b839c8-ab90-4248-8f8d-edd1b6dfa6ce req-a54178bc-e140-4f5e-ac1d-723f59efd96d service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-12b839c8-ab90-4248-8f8d-edd1b6dfa6ce req-a54178bc-e140-4f5e-ac1d-723f59efd96d service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:19 user nova-compute[75244]: WARNING nova.compute.manager [req-12b839c8-ab90-4248-8f8d-edd1b6dfa6ce req-a54178bc-e140-4f5e-ac1d-723f59efd96d service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5fedadb-a074-4984-a43b-ba9e9849684f tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.370s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-changed-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Refreshing instance network info cache due to event network-changed-1060dd82-54d4-4288-90bf-131c63174ffc. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] Acquiring lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] Acquired lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Refreshing network info cache for port 1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updated VIF entry in instance network info cache for port 1060dd82-54d4-4288-90bf-131c63174ffc. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updating instance_info_cache with network_info: [{"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-99936838-7f97-4f61-ae1f-1c82b62a1877 req-1d634e38-c5c0-4d17-a9e9-3fa4b2c487f4 service nova] Releasing lock "refresh_cache-90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:22 user nova-compute[75244]: INFO nova.compute.manager [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Attaching volume f074d6e7-5c0e-44e3-ab85-9a7926e5a848 to /dev/vdb
Nov 29 23:13:22 user nova-compute[75244]: DEBUG os_brick.utils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[123158a3-aa0d-4175-b666-caae2e8c262a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd98598b-90b7-4ad1-95e5-6f7916121a3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ececd98-20e5-43f4-91a6-8564552114dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8ec8dd-b931-42f9-8797-3b44dc2d0cb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:13:22 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:13:22 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd44e0-0134-42ec-bfe7-8855022afdb0]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG os_brick.utils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:22 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updating existing volume attachment record: f8c22f01-e0d0-41bb-8e06-8dc158730d26 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Starting finish_migration {{(pid=75244) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:13:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Creating image(s)
Nov 29 23:13:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk. size=21474836480 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:13:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk 21474836480 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk 21474836480" returned: 0 in 0.253s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Ensure instance console log exists: /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start _get_guest_xml network_info=[{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7156169f-5668-49cb-93dc-35009dfff4c4', 'attached_at': '2023-11-29T23:13:25.000000', 'detached_at': '', 'volume_id': 'ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'serial': 'ed984e2b-1b00-4864-80a3-22b6d3092a3c'}, 'attachment_id': '30102435-8382-4f32-af6a-5ac1000cdeae', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:13:26 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:26 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:26 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:26 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:26 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4535c76-3813-409e-8c63-aa0e98f283bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:13:26 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300f572-b51a-47ff-a476-f2fea0198566]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c] added
Nov 29 23:13:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9353342f-cdd9-4df4-b6c2-e9983f5790b9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e2a177-37ff-4a82-9c72-305e9e28f988]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQwCaIxg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQwCaIxg" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3d79d-22b5-4fda-95aa-dc54895ec1ac]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQwCaIxg'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe4baa-fb20-43ea-94a1-81334fb8e2e7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8153073-13ed-449d-9a0c-ea920372752c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[215d09c9-ef17-4beb-9230-baed5516040c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]
Nov 29 23:13:26 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f9d1e8-3aea-495e-b85e-3f0471220dba]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c8e00-cd69-4406-93ce-bc7c107c4148]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:26 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb9174-0544-40b4-bf81-ad42991d2d15]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:13:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26333363139636234', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363139636234', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:13:27 user nova-compute[75244]:   <uuid>7156169f-5668-49cb-93dc-35009dfff4c4</uuid>
Nov 29 23:13:27 user nova-compute[75244]:   <name>instance-00000015</name>
Nov 29 23:13:27 user nova-compute[75244]:   <memory>2097152</memory>
Nov 29 23:13:27 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:13:27 user nova-compute[75244]:   <metadata>
Nov 29 23:13:27 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:13:27 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:13:27 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherB-server-986679095</nova:name>
Nov 29 23:13:27 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:13:26</nova:creationTime>
Nov 29 23:13:27 user nova-compute[75244]:       <nova:flavor name="m1.small">
Nov 29 23:13:27 user nova-compute[75244]:         <nova:memory>2048</nova:memory>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:disk>20</nova:disk>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:13:27 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:13:27 user nova-compute[75244]:       <nova:owner>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:user uuid="579c42ce8eec4d1da0554d4797bde030">tempest-ServerActionsTestOtherB-1460963367-project-member</nova:user>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:project uuid="e2752170d04b4e3da54e0f7aa8d57e94">tempest-ServerActionsTestOtherB-1460963367</nova:project>
Nov 29 23:13:27 user nova-compute[75244]:       </nova:owner>
Nov 29 23:13:27 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:13:27 user nova-compute[75244]:       <nova:ports>
Nov 29 23:13:27 user nova-compute[75244]:         <nova:port uuid="beb2df2b-5192-4d17-8e62-09c480ce6e36">
Nov 29 23:13:27 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:13:27 user nova-compute[75244]:         </nova:port>
Nov 29 23:13:27 user nova-compute[75244]:       </nova:ports>
Nov 29 23:13:27 user nova-compute[75244]:     </nova:instance>
Nov 29 23:13:27 user nova-compute[75244]:   </metadata>
Nov 29 23:13:27 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:13:27 user nova-compute[75244]:     <system>
Nov 29 23:13:27 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:13:27 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:13:27 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:13:27 user nova-compute[75244]:       <entry name="serial">7156169f-5668-49cb-93dc-35009dfff4c4</entry>
Nov 29 23:13:27 user nova-compute[75244]:       <entry name="uuid">7156169f-5668-49cb-93dc-35009dfff4c4</entry>
Nov 29 23:13:27 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:13:27 user nova-compute[75244]:     </system>
Nov 29 23:13:27 user nova-compute[75244]:   </sysinfo>
Nov 29 23:13:27 user nova-compute[75244]:   <os>
Nov 29 23:13:27 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:13:27 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:13:27 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:13:27 user nova-compute[75244]:   </os>
Nov 29 23:13:27 user nova-compute[75244]:   <features>
Nov 29 23:13:27 user nova-compute[75244]:     <acpi/>
Nov 29 23:13:27 user nova-compute[75244]:     <apic/>
Nov 29 23:13:27 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:13:27 user nova-compute[75244]:   </features>
Nov 29 23:13:27 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:13:27 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:13:27 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:13:27 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:13:27 user nova-compute[75244]:   </clock>
Nov 29 23:13:27 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:13:27 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:13:27 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:13:27 user nova-compute[75244]:   </cpu>
Nov 29 23:13:27 user nova-compute[75244]:   <devices>
Nov 29 23:13:27 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:13:27 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:13:27 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk"/>
Nov 29 23:13:27 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:13:27 user nova-compute[75244]:     </disk>
Nov 29 23:13:27 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:13:27 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:27 user nova-compute[75244]:       <source dev="/dev/sde"/>
Nov 29 23:13:27 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:13:27 user nova-compute[75244]:       <serial>ed984e2b-1b00-4864-80a3-22b6d3092a3c</serial>
Nov 29 23:13:27 user nova-compute[75244]:     </disk>
Nov 29 23:13:27 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:13:27 user nova-compute[75244]:       <mac address="fa:16:3e:79:3f:62"/>
Nov 29 23:13:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:13:27 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:13:27 user nova-compute[75244]:       <target dev="tapbeb2df2b-51"/>
Nov 29 23:13:27 user nova-compute[75244]:     </interface>
Nov 29 23:13:27 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:13:27 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/console.log" append="off"/>
Nov 29 23:13:27 user nova-compute[75244]:     </serial>
Nov 29 23:13:27 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:13:27 user nova-compute[75244]:     <video>
Nov 29 23:13:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:13:27 user nova-compute[75244]:     </video>
Nov 29 23:13:27 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:13:27 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:13:27 user nova-compute[75244]:     </rng>
Nov 29 23:13:27 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:13:27 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:13:27 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:13:27 user nova-compute[75244]:     </memballoon>
Nov 29 23:13:27 user nova-compute[75244]:   </devices>
Nov 29 23:13:27 user nova-compute[75244]: </domain>
Nov 29 23:13:27 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-79574040-network", "vif_mac": "fa:16:3e:79:3f:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG os_vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5342bdf7-4f4b-5008-a689-b0c8ce1a60f9', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeb2df2b-51, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbeb2df2b-51, col_values=(('qos', UUID('46383606-6afa-419e-9b3c-9a27c4da2ea0')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbeb2df2b-51, col_values=(('external_ids', {'iface-id': 'beb2df2b-5192-4d17-8e62-09c480ce6e36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:3f:62', 'vm-uuid': '7156169f-5668-49cb-93dc-35009dfff4c4'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:27 user nova-compute[75244]: INFO os_vif [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51')
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] No VIF found with MAC fa:16:3e:79:3f:62, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-5d20e6c8-aa11-4d95-8871-4d786f98c7d9 req-4f60c573-5140-4d97-b81a-3ab6a1ebf886 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5d20e6c8-aa11-4d95-8871-4d786f98c7d9 req-4f60c573-5140-4d97-b81a-3ab6a1ebf886 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5d20e6c8-aa11-4d95-8871-4d786f98c7d9 req-4f60c573-5140-4d97-b81a-3ab6a1ebf886 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5d20e6c8-aa11-4d95-8871-4d786f98c7d9 req-4f60c573-5140-4d97-b81a-3ab6a1ebf886 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-5d20e6c8-aa11-4d95-8871-4d786f98c7d9 req-4f60c573-5140-4d97-b81a-3ab6a1ebf886 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:29 user nova-compute[75244]: WARNING nova.compute.manager [req-5d20e6c8-aa11-4d95-8871-4d786f98c7d9 req-4f60c573-5140-4d97-b81a-3ab6a1ebf886 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state active and task_state resize_finish.
Nov 29 23:13:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:13:31 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance running successfully.
Nov 29 23:13:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Failed to set time: agent not configured {{(pid=75244) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-06801b2a-346c-4c2d-b50c-85fedbdb7c36 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] finish_migration finished successfully. {{(pid=75244) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQqCoKDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:31 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:31 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:31 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:13:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-0bb617d4-5ae5-4e49-b180-1af456b0eb62 req-bd01af8d-3d67-46e6-ab22-63709554fbe0 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0bb617d4-5ae5-4e49-b180-1af456b0eb62 req-bd01af8d-3d67-46e6-ab22-63709554fbe0 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0bb617d4-5ae5-4e49-b180-1af456b0eb62 req-bd01af8d-3d67-46e6-ab22-63709554fbe0 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0bb617d4-5ae5-4e49-b180-1af456b0eb62 req-bd01af8d-3d67-46e6-ab22-63709554fbe0 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-0bb617d4-5ae5-4e49-b180-1af456b0eb62 req-bd01af8d-3d67-46e6-ab22-63709554fbe0 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:31 user nova-compute[75244]: WARNING nova.compute.manager [req-0bb617d4-5ae5-4e49-b180-1af456b0eb62 req-bd01af8d-3d67-46e6-ab22-63709554fbe0 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state active and task_state resize_finish.
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478b27c-810f-4dab-9e39-7092d7703f58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:13:31 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb1ab2-407a-4070-811c-1ac9f643d72c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848] added
Nov 29 23:13:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c16951-f328-4152-95fb-defb82e218bb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fded4a-cb2b-441e-a2f9-caa7011b4f23]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQqCoKDr {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQqCoKDr" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1532e8a7-b202-476c-a089-9024f67588ac]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mQqCoKDr'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c51ff2-e5d2-408a-9170-633ea631d688]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[904165fc-70c1-4ab0-a543-ae5260119709]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614cd0f-b4e8-4e60-b067-490d9b7b647e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260]
Nov 29 23:13:31 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aee46e3-6147-40a6-99ef-9ce7da7267da]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[75954a71-07b7-418b-b98c-b2d148424646]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)
Nov 29 23:13:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:31 user nova-compute[75244]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)
Nov 29 23:13:31 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:13:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:32 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.169s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:32 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77bfc78-2967-414b-8735-fd49ab39c1c1]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:32 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQqCoKDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23934353931646262', 'path': '/dev/sdf'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934353931646262', 'path': '/dev/sdf'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG nova.objects.instance [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:13:33 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:33 user nova-compute[75244]:   <source dev="/dev/sdf"/>
Nov 29 23:13:33 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:13:33 user nova-compute[75244]:   <serial>f074d6e7-5c0e-44e3-ab85-9a7926e5a848</serial>
Nov 29 23:13:33 user nova-compute[75244]: </disk>
Nov 29 23:13:33 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:a6:d4:4e, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:13:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-447703e4-2e7e-492a-942f-290de618dd93 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.237s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:34 user nova-compute[75244]: INFO nova.compute.manager [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Detaching volume f074d6e7-5c0e-44e3-ab85-9a7926e5a848
Nov 29 23:13:34 user nova-compute[75244]: INFO nova.virt.block_device [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Attempting to driver detach volume f074d6e7-5c0e-44e3-ab85-9a7926e5a848 from mountpoint /dev/vdb
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Attempting to detach device vdb from instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:13:34 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:34 user nova-compute[75244]:   <source dev="/dev/sdf"/>
Nov 29 23:13:34 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:13:34 user nova-compute[75244]:   <serial>f074d6e7-5c0e-44e3-ab85-9a7926e5a848</serial>
Nov 29 23:13:34 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:13:34 user nova-compute[75244]: </disk>
Nov 29 23:13:34 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:13:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully detached device vdb from instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd from the persistent domain config.
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:13:34 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:13:34 user nova-compute[75244]:   <source dev="/dev/sdf"/>
Nov 29 23:13:34 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:13:34 user nova-compute[75244]:   <serial>f074d6e7-5c0e-44e3-ab85-9a7926e5a848</serial>
Nov 29 23:13:34 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:13:34 user nova-compute[75244]: </disk>
Nov 29 23:13:34 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:13:34 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:13:35 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5eadf8f0-a801-47b5-99d8-34812a0d83db is timed out.
Nov 29 23:13:35 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully detached device vdb from instance 5eadf8f0-a801-47b5-99d8-34812a0d83db from the live domain config.
Nov 29 23:13:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwmzqTOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:35 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c8ca3-303c-4281-91a3-7c7e07843e80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:13:35 user nova-compute[75244]: No targets found.
Nov 29 23:13:35 user nova-compute[75244]: iSNS:
Nov 29 23:13:35 user nova-compute[75244]: No targets found.
Nov 29 23:13:35 user nova-compute[75244]: STATIC:
Nov 29 23:13:35 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e
Nov 29 23:13:35 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:35 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:35 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:13:35 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:35 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:35 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:13:35 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:35 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:35 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:13:35 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:35 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:35 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848
Nov 29 23:13:35 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:35 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:35 user nova-compute[75244]: FIRMWARE:
Nov 29 23:13:35 user nova-compute[75244]: No targets found.
Nov 29 23:13:35 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:13:35 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:13:35 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478dbe2-9f41-4de8-831d-3a1c858105d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d3ef88-c993-4ca8-8bac-1bfc043e2607]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)
Nov 29 23:13:35 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:35 user nova-compute[75244]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)
Nov 29 23:13:35 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8042ec670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ded111c-c142-48c9-b05b-a73d266e30cd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b66ffe-838e-40cd-a8c5-60eb1b560363]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09851a3-d74f-4006-b193-472c6791a8a0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd8ca7-2ee1-4e88-bb36-3ddb40740e5c]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00431c0-3c1c-4548-bc11-18ca582509d0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d164914-072b-4057-ba0a-10c9512bd44e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260]
Nov 29 23:13:35 user nova-compute[75244]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:35 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5348d649-9d67-419b-9f9b-cb4d6265201e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7bd13-358c-446c-ac29-812063e4f299]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] <== disconnect_volume: return (321ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:13:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'flavor' on Instance uuid 5eadf8f0-a801-47b5-99d8-34812a0d83db {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b566a986-3314-4fa6-9d0e-dc5568c90bb0 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.839s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing instance network info cache due to event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:13:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updated VIF entry in instance network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:13:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d55d441a-cf53-48bb-a52c-98f098735034 req-eaaa7ff8-2718-4e9b-858e-a822cf1853c6 service nova] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:37 user nova-compute[75244]: INFO nova.compute.manager [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Unrescuing
Nov 29 23:13:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:13:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:13:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:13:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:13:38 user nova-compute[75244]: INFO nova.compute.manager [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] instance snapshotting
Nov 29 23:13:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Beginning live snapshot process
Nov 29 23:13:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'flavor' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-3d5edd2c-9e86-40a2-847e-16c8c5837211 req-44a0efed-33bc-4e93-b78f-911cc2f58efd service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3d5edd2c-9e86-40a2-847e-16c8c5837211 req-44a0efed-33bc-4e93-b78f-911cc2f58efd service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3d5edd2c-9e86-40a2-847e-16c8c5837211 req-44a0efed-33bc-4e93-b78f-911cc2f58efd service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3d5edd2c-9e86-40a2-847e-16c8c5837211 req-44a0efed-33bc-4e93-b78f-911cc2f58efd service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-3d5edd2c-9e86-40a2-847e-16c8c5837211 req-44a0efed-33bc-4e93-b78f-911cc2f58efd service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:39 user nova-compute[75244]: WARNING nova.compute.manager [req-3d5edd2c-9e86-40a2-847e-16c8c5837211 req-44a0efed-33bc-4e93-b78f-911cc2f58efd service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:13:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpekmr5z2q/3cc3d038d46c455ba0c70961042f3942.delta 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpekmr5z2q/3cc3d038d46c455ba0c70961042f3942.delta 1073741824" returned: 0 in 0.048s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:39 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 23:13:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance destroyed successfully.
Nov 29 23:13:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:13:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 23:13:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:13:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpekmr5z2q/3cc3d038d46c455ba0c70961042f3942.delta /opt/stack/data/nova/instances/snapshots/tmpekmr5z2q/3cc3d038d46c455ba0c70961042f3942 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-d572935a-25bf-4bfb-80a2-154d71a9b4ce req-9f4c9ab3-8190-4d36-8c9f-be66913f70ed service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d572935a-25bf-4bfb-80a2-154d71a9b4ce req-9f4c9ab3-8190-4d36-8c9f-be66913f70ed service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d572935a-25bf-4bfb-80a2-154d71a9b4ce req-9f4c9ab3-8190-4d36-8c9f-be66913f70ed service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d572935a-25bf-4bfb-80a2-154d71a9b4ce req-9f4c9ab3-8190-4d36-8c9f-be66913f70ed service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-d572935a-25bf-4bfb-80a2-154d71a9b4ce req-9f4c9ab3-8190-4d36-8c9f-be66913f70ed service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:41 user nova-compute[75244]: WARNING nova.compute.manager [req-d572935a-25bf-4bfb-80a2-154d71a9b4ce req-9f4c9ab3-8190-4d36-8c9f-be66913f70ed service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:13:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpekmr5z2q/3cc3d038d46c455ba0c70961042f3942.delta /opt/stack/data/nova/instances/snapshots/tmpekmr5z2q/3cc3d038d46c455ba0c70961042f3942" returned: 0 in 0.600s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:41 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Snapshot extracted, beginning image upload
Nov 29 23:13:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:43 user nova-compute[75244]: WARNING nova.compute.manager [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:13:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:13:43 user nova-compute[75244]: WARNING nova.compute.manager [req-db9865b0-e00e-4203-84e7-983e01b4043a req-902acee8-1c64-43b1-9b39-eeba6fced807 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:13:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ee90d3db-b562-456e-b043-fb2847544e77 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Snapshot image upload complete
Nov 29 23:13:44 user nova-compute[75244]: INFO nova.compute.manager [None req-b9cb9cd8-2026-416c-bfec-424fe897e8c8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Took 6.18 seconds to snapshot the instance on the hypervisor.
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:13:47 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:47 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=24.9676513671875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Applying migration context for instance 7156169f-5668-49cb-93dc-35009dfff4c4 as it has an incoming, in-progress migration c5765990-1530-4271-90e1-a87af20101e3. Migration status is finished {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 23:13:47 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating resource usage from migration c5765990-1530-4271-90e1-a87af20101e3
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5eadf8f0-a801-47b5-99d8-34812a0d83db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 089b181a-b746-4a25-94ad-50fd268a7cd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 24054fdc-8f5e-4352-bdfa-717f288152bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Migration c5765990-1530-4271-90e1-a87af20101e3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:13:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:13:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:13:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd is timed out.
Nov 29 23:13:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully detached device vdb from instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd from the live domain config.
Nov 29 23:13:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQqCoKDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:13:55 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ce5bc3-9ccc-4524-9217-cbd08e882cee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:13:55 user nova-compute[75244]: No targets found.
Nov 29 23:13:55 user nova-compute[75244]: iSNS:
Nov 29 23:13:55 user nova-compute[75244]: No targets found.
Nov 29 23:13:55 user nova-compute[75244]: STATIC:
Nov 29 23:13:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:13:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:13:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:13:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848
Nov 29 23:13:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:13:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:13:55 user nova-compute[75244]: FIRMWARE:
Nov 29 23:13:55 user nova-compute[75244]: No targets found.
Nov 29 23:13:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:13:55 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:13:55 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7044579-5865-4066-8aa6-3788d7e28b64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[13db643e-fa90-405e-b520-5f35f13d4095]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:55 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:55 user nova-compute[75244]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)
Nov 29 23:13:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:13:55 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:13:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:13:55 user nova-compute[75244]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 (non-flash)
Nov 29 23:13:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c40a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848'): ({'sdf'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Removing single pathed devices sdf {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ea3af-92f7-4fd3-aa6a-a165861a202b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[51213cd0-df6a-4831-8c90-656d7dee8081]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flushing IO for device /dev/sdf {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1aa06e-065b-44aa-9987-d0af3e90ec96]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af0a898-1dbf-4e24-8b52-8e21f904e30b]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] SCSI volumes sdf have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e845de6-c31c-40dd-971a-3c722091f933]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24fa72a-f3ec-49aa-bdde-9b18f315ffbb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260]
Nov 29 23:13:55 user nova-compute[75244]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848, portal: 172.16.0.220,3260] successful.
Nov 29 23:13:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f074d6e7-5c0e-44e3-ab85-9a7926e5a848 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1866b412-2191-4731-ac32-c562bab6561d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== disconnect_volume: return (305ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:13:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:13:56 user nova-compute[75244]: DEBUG nova.objects.instance [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:13:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-21e84b9f-ba3a-4aea-8e49-eacd2446312a tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:13:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:09 user nova-compute[75244]: INFO nova.compute.manager [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Terminating instance
Nov 29 23:14:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-49bc2f33-7d87-4710-b78e-8ac2999132f1 req-fed95ec0-a97f-45bf-85ee-55472fef7952 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-unplugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49bc2f33-7d87-4710-b78e-8ac2999132f1 req-fed95ec0-a97f-45bf-85ee-55472fef7952 service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49bc2f33-7d87-4710-b78e-8ac2999132f1 req-fed95ec0-a97f-45bf-85ee-55472fef7952 service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-49bc2f33-7d87-4710-b78e-8ac2999132f1 req-fed95ec0-a97f-45bf-85ee-55472fef7952 service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-49bc2f33-7d87-4710-b78e-8ac2999132f1 req-fed95ec0-a97f-45bf-85ee-55472fef7952 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-unplugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-49bc2f33-7d87-4710-b78e-8ac2999132f1 req-fed95ec0-a97f-45bf-85ee-55472fef7952 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-unplugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:14:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Instance destroyed successfully.
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.objects.instance [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lazy-loading 'resources' on Instance uuid 5eadf8f0-a801-47b5-99d8-34812a0d83db {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-612060254',display_name='tempest-TestMinimumBasicScenario-server-612060254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-612060254',id=20,image_ref='a2c034e3-5b5c-4756-95f5-5f1fc5eafd81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+Jt6pSeBdZJGu0jj1pGvMBKZy+lwjcDiBXteI7METI/I4CmTyh8Y7K9gKH4ev2qmG0tHtVO45BXGsYCEij/vpSVmxFp7vI67LUS9HjjsGjug//GAzopCMxNLFK6utOuQ==',key_name='tempest-TestMinimumBasicScenario-1932079665',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='555c96d9ec5c48fe814663a5cdd84ffa',ramdisk_id='',reservation_id='r-cwy1c0qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a2c034e3-5b5c-4756-95f5-5f1fc5eafd81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1628079571',owner_user_name='tempest-TestMinimumBasicScenario-1628079571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:11:29Z,user_data=None,user_id='34cc981cad504120ac7e4507e9c08fcd',uuid=5eadf8f0-a801-47b5-99d8-34812a0d83db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converting VIF {"id": "17d779a7-8523-4a82-a9da-534db4d80939", "address": "fa:16:3e:d9:c1:0a", "network": {"id": "26751164-9c57-4bdf-9403-040d408f3d91", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1772501490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "555c96d9ec5c48fe814663a5cdd84ffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d779a7-85", "ovs_interfaceid": "17d779a7-8523-4a82-a9da-534db4d80939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG os_vif [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17d779a7-85, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=490f0bf9-acb1-4ce7-a9e8-8d8bb20923b4) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: INFO os_vif [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=17d779a7-8523-4a82-a9da-534db4d80939,network=Network(26751164-9c57-4bdf-9403-040d408f3d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d779a7-85')
Nov 29 23:14:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Deleting instance files /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db_del
Nov 29 23:14:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Deletion of /opt/stack/data/nova/instances/5eadf8f0-a801-47b5-99d8-34812a0d83db_del complete
Nov 29 23:14:10 user nova-compute[75244]: INFO nova.compute.manager [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 23:14:10 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:10 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Took 0.46 seconds to deallocate network for instance.
Nov 29 23:14:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-5ba86a0d-5a4b-4af8-bf78-657bd4fc5b12 req-50cd19ac-ac44-4590-bcc0-3211f136a5b6 service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-deleted-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:11 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Deleted allocations for instance 5eadf8f0-a801-47b5-99d8-34812a0d83db
Nov 29 23:14:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-146a7441-659f-4c33-b3e0-ff02edb788f4 tempest-TestMinimumBasicScenario-1628079571 tempest-TestMinimumBasicScenario-1628079571-project-member] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-e78030fd-6c49-47bb-87b7-794474cc21c4 req-9611e7bd-195b-4731-850d-d55aa8ac761c service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e78030fd-6c49-47bb-87b7-794474cc21c4 req-9611e7bd-195b-4731-850d-d55aa8ac761c service nova] Acquiring lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e78030fd-6c49-47bb-87b7-794474cc21c4 req-9611e7bd-195b-4731-850d-d55aa8ac761c service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e78030fd-6c49-47bb-87b7-794474cc21c4 req-9611e7bd-195b-4731-850d-d55aa8ac761c service nova] Lock "5eadf8f0-a801-47b5-99d8-34812a0d83db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-e78030fd-6c49-47bb-87b7-794474cc21c4 req-9611e7bd-195b-4731-850d-d55aa8ac761c service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] No waiting events found dispatching network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:11 user nova-compute[75244]: WARNING nova.compute.manager [req-e78030fd-6c49-47bb-87b7-794474cc21c4 req-9611e7bd-195b-4731-850d-d55aa8ac761c service nova] [instance: 5eadf8f0-a801-47b5-99d8-34812a0d83db] Received unexpected event network-vif-plugged-17d779a7-8523-4a82-a9da-534db4d80939 for instance with vm_state deleted and task_state None.
Nov 29 23:14:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:14:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:14:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:14:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:25 user nova-compute[75244]: INFO nova.compute.manager [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Terminating instance
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a794f01-c9c2-4e02-9f3b-1398a87e830f req-320e63d5-5730-46b9-9f3b-adacffbd0003 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-vif-unplugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a794f01-c9c2-4e02-9f3b-1398a87e830f req-320e63d5-5730-46b9-9f3b-adacffbd0003 service nova] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a794f01-c9c2-4e02-9f3b-1398a87e830f req-320e63d5-5730-46b9-9f3b-adacffbd0003 service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a794f01-c9c2-4e02-9f3b-1398a87e830f req-320e63d5-5730-46b9-9f3b-adacffbd0003 service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a794f01-c9c2-4e02-9f3b-1398a87e830f req-320e63d5-5730-46b9-9f3b-adacffbd0003 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] No waiting events found dispatching network-vif-unplugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a794f01-c9c2-4e02-9f3b-1398a87e830f req-320e63d5-5730-46b9-9f3b-adacffbd0003 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-vif-unplugged-1060dd82-54d4-4288-90bf-131c63174ffc for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:14:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Instance destroyed successfully.
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'resources' on Instance uuid 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-822058595',display_name='tempest-AttachVolumeNegativeTest-server-822058595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-822058595',id=26,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYVVi4LWa1thEwKrHPaC2OFDZY3mo8qtKID4139NkPPob4T0psLHQr2wfb2FssY2rrlhQMVzz5XNjpi4UT0stQoGZHKk2m0KDyRFKRXM3XxXwYNsQGmaW79+IgrQaXhow==',key_name='tempest-keypair-1928654152',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:11:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-h0yd8e0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=90872dcf-9b55-4ed2-b52b-6d10eef6e4dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "1060dd82-54d4-4288-90bf-131c63174ffc", "address": "fa:16:3e:a6:d4:4e", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1060dd82-54", "ovs_interfaceid": "1060dd82-54d4-4288-90bf-131c63174ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG os_vif [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1060dd82-54, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cda44215-bfe3-47a6-8929-53e9f22f4c9f) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:25 user nova-compute[75244]: INFO os_vif [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:d4:4e,bridge_name='br-int',has_traffic_filtering=True,id=1060dd82-54d4-4288-90bf-131c63174ffc,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1060dd82-54')
Nov 29 23:14:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Deleting instance files /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd_del
Nov 29 23:14:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Deletion of /opt/stack/data/nova/instances/90872dcf-9b55-4ed2-b52b-6d10eef6e4dd_del complete
Nov 29 23:14:25 user nova-compute[75244]: INFO nova.compute.manager [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 23:14:25 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:14:25 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:14:26 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:26 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Took 0.75 seconds to deallocate network for instance.
Nov 29 23:14:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-d791d67c-81f8-4c3a-8a68-d08c9f89285f req-e2f737f2-ec88-4ae5-9b2e-943929c26d14 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-vif-deleted-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:27 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Deleted allocations for instance 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd
Nov 29 23:14:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8022d2c8-228c-4256-9cb2-1b4cde5fe501 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.153s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG nova.compute.manager [req-86645c03-15f6-4cbe-bc96-e9414e4b2b60 req-e818fcd1-8513-4d32-97bc-aae6f6662c14 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received event network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86645c03-15f6-4cbe-bc96-e9414e4b2b60 req-e818fcd1-8513-4d32-97bc-aae6f6662c14 service nova] Acquiring lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86645c03-15f6-4cbe-bc96-e9414e4b2b60 req-e818fcd1-8513-4d32-97bc-aae6f6662c14 service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86645c03-15f6-4cbe-bc96-e9414e4b2b60 req-e818fcd1-8513-4d32-97bc-aae6f6662c14 service nova] Lock "90872dcf-9b55-4ed2-b52b-6d10eef6e4dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:27 user nova-compute[75244]: DEBUG nova.compute.manager [req-86645c03-15f6-4cbe-bc96-e9414e4b2b60 req-e818fcd1-8513-4d32-97bc-aae6f6662c14 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] No waiting events found dispatching network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:27 user nova-compute[75244]: WARNING nova.compute.manager [req-86645c03-15f6-4cbe-bc96-e9414e4b2b60 req-e818fcd1-8513-4d32-97bc-aae6f6662c14 service nova] [instance: 90872dcf-9b55-4ed2-b52b-6d10eef6e4dd] Received unexpected event network-vif-plugged-1060dd82-54d4-4288-90bf-131c63174ffc for instance with vm_state deleted and task_state None.
Nov 29 23:14:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-changed-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Refreshing instance network info cache due to event network-changed-0e8c8d42-4990-43a5-9060-d4625842f795. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] Acquiring lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] Acquired lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG nova.network.neutron [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Refreshing network info cache for port 0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG nova.network.neutron [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updated VIF entry in instance network info cache for port 0e8c8d42-4990-43a5-9060-d4625842f795. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG nova.network.neutron [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updating instance_info_cache with network_info: [{"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b4549c1c-3d2c-4cf7-b555-6479c03ac098 req-c5104957-4708-4480-809c-d972e52d9979 service nova] Releasing lock "refresh_cache-cbf0aa1a-70a3-44c0-a6c4-0276ea375300" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:33 user nova-compute[75244]: INFO nova.compute.manager [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attaching volume 5dbd20b0-3adc-42bd-ba87-6848070a0b73 to /dev/vdb
Nov 29 23:14:33 user nova-compute[75244]: DEBUG os_brick.utils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e318500-2fa5-4471-888e-2b5fe26091c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc44166-8601-42af-bacb-66695913cb0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.043s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e8ef63-380c-42f5-bd0c-c7a9b6e57d39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fba6d4-6fa5-40a6-8369-46eff9034d7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:14:33 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:14:33 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e0bc3-efd0-43e5-8160-22c7472678e5]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG os_brick.utils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:14:33 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updating existing volume attachment record: fb015c2b-97ce-402a-87c3-28a31cda7ccc {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:14:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:14:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:14:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:14:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:14:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:14:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:14:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnlbvdWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:14:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:14:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:14:41 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f088b24-5a01-43e0-a216-20f8123f4cbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:14:41 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0768b-e8e4-490c-a96a-8589b5ee027d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73] added
Nov 29 23:14:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb638d-6ba3-4523-b8cc-380d0291b03c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c36a0c-65f9-41cc-b41f-03f02daa0cc3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SnlbvdWh {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SnlbvdWh" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69c1cf-4cb9-46f2-98ee-ce29021cb925]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SnlbvdWh'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84d8788-177b-4b04-b9b0-0f9195128457]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4dd40-efc2-4b20-9302-779c3a199d9a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc850b5-7379-4a7a-bf4a-a8a4e628f66f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260]
Nov 29 23:14:41 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260] successful.
Nov 29 23:14:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[357c72b2-c7b8-412f-bc87-6b19fc6fe341]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1057bf5-7dea-4d45-ae8e-1d4721d1576c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:41 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c0aa79-b74e-4509-98c0-d7dd0bac5f31]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnlbvdWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23364393131306437', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364393131306437', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:14:42 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:14:42 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:14:42 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:14:42 user nova-compute[75244]:   <serial>5dbd20b0-3adc-42bd-ba87-6848070a0b73</serial>
Nov 29 23:14:42 user nova-compute[75244]: </disk>
Nov 29 23:14:42 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No VIF found with MAC fa:16:3e:38:e3:92, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d1a307c-fbb3-4140-afce-df233e600eff tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.132s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:14:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:14:44 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:14:44 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=24.99976348876953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Applying migration context for instance 7156169f-5668-49cb-93dc-35009dfff4c4 as it has an incoming, in-progress migration c5765990-1530-4271-90e1-a87af20101e3. Migration status is finished {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 23:14:44 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating resource usage from migration c5765990-1530-4271-90e1-a87af20101e3
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 089b181a-b746-4a25-94ad-50fd268a7cd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 24054fdc-8f5e-4352-bdfa-717f288152bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Migration c5765990-1530-4271-90e1-a87af20101e3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:14:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:46 user nova-compute[75244]: INFO nova.compute.manager [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attaching volume b42502d3-687a-4237-931f-d362c357bb6c to /dev/vdc
Nov 29 23:14:47 user nova-compute[75244]: DEBUG os_brick.utils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a95dd-5d09-459f-8040-178f1247fc20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[795bb75f-48e0-4e31-89b2-85afb7ab0361]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b456583-05c8-41a9-bdbe-6f86df4dc7d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755f707-cc13-480a-ba3d-277b70cb3ac3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:14:47 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5d2930-34b4-42c7-af1d-0ad6ef48e6ff]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG os_brick.utils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updating existing volume attachment record: bcb10fe5-209e-4a60-b2ed-d2cbdf47e073 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:47 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:14:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:14:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:14:52 user nova-compute[75244]: INFO nova.compute.claims [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Claim successful on node user
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.network.neutron [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:14:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:14:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.policy [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6d9dd0466344edc8b9aad74fd1fe1b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f36d441ef074e09bcb59e29b03b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:14:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Creating image(s)
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk 1073741824" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing instance network info cache due to event network-changed-cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] Acquiring lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] Acquired lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Refreshing network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:53 user nova-compute[75244]: INFO nova.compute.manager [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Terminating instance
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.network.neutron [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Successfully created port: 796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Cannot resize image /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Ensure instance console log exists: /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:53 user nova-compute[75244]: INFO nova.compute.manager [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Terminating instance
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-d6adbb97-5ec1-4971-bc2a-064b52eea912 req-362e45e3-f85e-428e-a4f7-ed95664e9c82 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d6adbb97-5ec1-4971-bc2a-064b52eea912 req-362e45e3-f85e-428e-a4f7-ed95664e9c82 service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d6adbb97-5ec1-4971-bc2a-064b52eea912 req-362e45e3-f85e-428e-a4f7-ed95664e9c82 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d6adbb97-5ec1-4971-bc2a-064b52eea912 req-362e45e3-f85e-428e-a4f7-ed95664e9c82 service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-d6adbb97-5ec1-4971-bc2a-064b52eea912 req-362e45e3-f85e-428e-a4f7-ed95664e9c82 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-d6adbb97-5ec1-4971-bc2a-064b52eea912 req-362e45e3-f85e-428e-a4f7-ed95664e9c82 service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updated VIF entry in instance network info cache for port cb3b5745-668b-43f3-a685-d55bbd873b3e. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [{"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9fdfd634-e6b0-45b5-8528-6eaac9099cd9 req-f5c473a9-050f-4fe9-b138-01efea8e26d9 service nova] Releasing lock "refresh_cache-089b181a-b746-4a25-94ad-50fd268a7cd9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Instance destroyed successfully.
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lazy-loading 'resources' on Instance uuid 089b181a-b746-4a25-94ad-50fd268a7cd9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Instance destroyed successfully.
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lazy-loading 'resources' on Instance uuid 24054fdc-8f5e-4352-bdfa-717f288152bf {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2123477696',display_name='tempest-TestShelveInstance-server-2123477696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2123477696',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL742LDaSYEIJTG907ugPcoBYVgqmhGoBMpBoZpcEMdn3/W8GzfjUv2h9hWAysqCjwIGr4cnPexh2SKIBfkgaxCwjzJggxvP5FLaGh/etBhuzzY4w3WIZCOCsin6CpECg==',key_name='tempest-TestShelveInstance-888719108',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0258ba7ccde40a09e3e251fbef77431',ramdisk_id='',reservation_id='r-i514jhss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1542675207',owner_user_name='tempest-TestShelveInstance-1542675207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:13:19Z,user_data=None,user_id='476af5a1d41146788ce60db8a2683f23',uuid=089b181a-b746-4a25-94ad-50fd268a7cd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converting VIF {"id": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "address": "fa:16:3e:23:77:dc", "network": {"id": "26da30cf-2cc0-42df-ae63-1c1b4e21ef17", "bridge": "br-int", "label": "tempest-TestShelveInstance-1747491711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0258ba7ccde40a09e3e251fbef77431", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3b5745-66", "ovs_interfaceid": "cb3b5745-668b-43f3-a685-d55bbd873b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG os_vif [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1486852029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1486852029',id=22,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCC67DzG1riKGxi2wUbXu8EmjvRfVhTQnD6socBdd5qUlfc30W3AZ8lpHpQVcfr3eD3zoaTTFqx/r9VKbu1vB5DLu34KfDPjQJ4BRFCCjn7VFZOTWVP+WvaxudiQmh0Lw==',key_name='tempest-keypair-17102318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b273a67b0a2f462aa1092779f31fdc8a',ramdisk_id='',reservation_id='r-d87zlrs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576906296',owner_user_name='tempest-AttachVolumeShelveTestJSON-576906296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe39bc0caf6f49368d0d0cb0789a1d3c',uuid=24054fdc-8f5e-4352-bdfa-717f288152bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converting VIF {"id": "e96d8f49-a385-4553-805a-a353f62944ac", "address": "fa:16:3e:e0:63:10", "network": {"id": "fed965ff-af89-4ff6-b8de-d31d5728ae9f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1938675542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b273a67b0a2f462aa1092779f31fdc8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96d8f49-a3", "ovs_interfaceid": "e96d8f49-a385-4553-805a-a353f62944ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG os_vif [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb3b5745-66, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape96d8f49-a3, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e297619-86cc-4227-b102-0827fbb7d3f5) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b247258f-f053-4bfb-8ab8-904f9d4b1979) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: INFO os_vif [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:77:dc,bridge_name='br-int',has_traffic_filtering=True,id=cb3b5745-668b-43f3-a685-d55bbd873b3e,network=Network(26da30cf-2cc0-42df-ae63-1c1b4e21ef17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3b5745-66')
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:55 user nova-compute[75244]: INFO os_vif [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:10,bridge_name='br-int',has_traffic_filtering=True,id=e96d8f49-a385-4553-805a-a353f62944ac,network=Network(fed965ff-af89-4ff6-b8de-d31d5728ae9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96d8f49-a3')
Nov 29 23:14:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Deleting instance files /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf_del
Nov 29 23:14:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Deletion of /opt/stack/data/nova/instances/24054fdc-8f5e-4352-bdfa-717f288152bf_del complete
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwJnuRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:14:55 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9849c26-19a1-4695-b9ba-93f58ddad7d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:14:55 user nova-compute[75244]: No targets found.
Nov 29 23:14:55 user nova-compute[75244]: iSNS:
Nov 29 23:14:55 user nova-compute[75244]: No targets found.
Nov 29 23:14:55 user nova-compute[75244]: STATIC:
Nov 29 23:14:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:14:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:14:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:14:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af
Nov 29 23:14:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:14:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:14:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73
Nov 29 23:14:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:14:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:14:55 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:14:55 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:14:55 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:14:55 user nova-compute[75244]: FIRMWARE:
Nov 29 23:14:55 user nova-compute[75244]: No targets found.
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:14:55 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:14:55 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824d8f6-e728-4b59-8276-94f722dbc674]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: INFO nova.compute.manager [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cababd-519e-4e24-b0b8-f91b0fb8ab9b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c40ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfb07d4-dedb-423e-aa6f-3a7c4fd4d53c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae06bdce-b108-4ad8-ba8a-be1e3a4c7e2e]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[91686020-e61d-4b1f-be52-34843d036a8f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe2e026-6dd1-4398-863b-ad392524a4b4]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad99b697-d3cd-4a72-a90f-ed644c0b226d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a624e020-54ec-40a2-89dc-2f3daccf720a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260]
Nov 29 23:14:55 user nova-compute[75244]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af, portal: 172.16.0.220,3260] successful.
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cf0e830-0613-46a9-badd-bca0a18cd8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6419233-421d-4ecb-8f28-5c03bc276373]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] <== disconnect_volume: return (357ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:14:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Deleting instance files /opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9_del
Nov 29 23:14:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Deletion of /opt/stack/data/nova/instances/089b181a-b746-4a25-94ad-50fd268a7cd9_del complete
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moDhRxri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:14:55 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:14:55 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:14:55 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: INFO nova.compute.manager [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Took 1.69 seconds to destroy the instance on the hypervisor.
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[65257d38-d5b2-47ee-853e-026db07773e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:14:55 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fbb39-4b0c-48ed-b7da-09e7ccd749f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c] added
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c30bde-b209-40ac-aeaa-a35d72746f7c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda11860-17cf-4680-974d-f0ff1b573b37]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moDhRxri {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moDhRxri" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cf3aa5-dbeb-4bb6-aad8-53bc98074172]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moDhRxri'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64add1d-82ac-4347-bf53-bdb2aa3aeb5e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7bce58-ea04-4514-b2ba-529fff8ed81b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-unplugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] Acquiring lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] No waiting events found dispatching network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:55 user nova-compute[75244]: WARNING nova.compute.manager [req-68b9ef02-0dec-4847-af67-ff6801ca5560 req-8494aa22-14a4-4765-8987-8214bcb1684a service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received unexpected event network-vif-plugged-cb3b5745-668b-43f3-a685-d55bbd873b3e for instance with vm_state active and task_state deleting.
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[36564be3-ab76-433f-8937-3fd1fa294b76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260]
Nov 29 23:14:55 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260] successful.
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca373ee-6464-49ec-992a-0b4f8d41949a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Successfully updated port: 796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c990738-be2b-427e-9a41-62593a109ec1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:14:55 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:14:55 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquired lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea61080-30b4-4fea-bebc-0d409cea3c6d]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-changed-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Refreshing instance network info cache due to event network-changed-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] Acquiring lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moDhRxri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:14:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:56 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Took 0.52 seconds to deallocate network for instance.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updating instance_info_cache with network_info: [{"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Releasing lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance network_info: |[{"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] Acquired lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.neutron [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Refreshing network info cache for port 796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Start _get_guest_xml network_info=[{"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:14:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:14:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1643090801',display_name='tempest-tempest.common.compute-instance-1643090801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1643090801',id=29,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErh/VToo0qYK6+7fEb47QasHwkBDh/Di7DcZqgW5G5XcHJcicmvkwPEc73bpsWhk53vBOdaarefC0jqkVt2PY7VV6Oq48EkCO2rbi5COodppn+fElofB2+D+fgtpAooDw==',key_name='tempest-keypair-1881256599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-6bytho4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1bac525e-daeb-49d9-a4bc-96bf5bd2543d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.objects.instance [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:56 user nova-compute[75244]: WARNING nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state active and task_state deleting.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:56 user nova-compute[75244]: WARNING nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state active and task_state deleting.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:56 user nova-compute[75244]: WARNING nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state active and task_state deleting.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-unplugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Acquiring lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] No waiting events found dispatching network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:56 user nova-compute[75244]: WARNING nova.compute.manager [req-f17b5620-f969-4df3-97c2-02584284b4f2 req-4a060619-a62f-4533-89b9-86b905234a7c service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received unexpected event network-vif-plugged-e96d8f49-a385-4553-805a-a353f62944ac for instance with vm_state active and task_state deleting.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:14:56 user nova-compute[75244]:   <uuid>1bac525e-daeb-49d9-a4bc-96bf5bd2543d</uuid>
Nov 29 23:14:56 user nova-compute[75244]:   <name>instance-0000001d</name>
Nov 29 23:14:56 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:14:56 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:14:56 user nova-compute[75244]:   <metadata>
Nov 29 23:14:56 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:14:56 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:14:56 user nova-compute[75244]:       <nova:name>tempest-tempest.common.compute-instance-1643090801</nova:name>
Nov 29 23:14:56 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:14:56</nova:creationTime>
Nov 29 23:14:56 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:14:56 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:14:56 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:14:56 user nova-compute[75244]:       <nova:owner>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:user uuid="c6d9dd0466344edc8b9aad74fd1fe1b0">tempest-ServerActionsTestOtherA-1557642123-project-member</nova:user>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:project uuid="6f36d441ef074e09bcb59e29b03b5e77">tempest-ServerActionsTestOtherA-1557642123</nova:project>
Nov 29 23:14:56 user nova-compute[75244]:       </nova:owner>
Nov 29 23:14:56 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:14:56 user nova-compute[75244]:       <nova:ports>
Nov 29 23:14:56 user nova-compute[75244]:         <nova:port uuid="796f511a-90e8-4b6f-8bc0-25ed0d7fff0f">
Nov 29 23:14:56 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:14:56 user nova-compute[75244]:         </nova:port>
Nov 29 23:14:56 user nova-compute[75244]:       </nova:ports>
Nov 29 23:14:56 user nova-compute[75244]:     </nova:instance>
Nov 29 23:14:56 user nova-compute[75244]:   </metadata>
Nov 29 23:14:56 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:14:56 user nova-compute[75244]:     <system>
Nov 29 23:14:56 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:14:56 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:14:56 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:14:56 user nova-compute[75244]:       <entry name="serial">1bac525e-daeb-49d9-a4bc-96bf5bd2543d</entry>
Nov 29 23:14:56 user nova-compute[75244]:       <entry name="uuid">1bac525e-daeb-49d9-a4bc-96bf5bd2543d</entry>
Nov 29 23:14:56 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:14:56 user nova-compute[75244]:     </system>
Nov 29 23:14:56 user nova-compute[75244]:   </sysinfo>
Nov 29 23:14:56 user nova-compute[75244]:   <os>
Nov 29 23:14:56 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:14:56 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:14:56 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:14:56 user nova-compute[75244]:   </os>
Nov 29 23:14:56 user nova-compute[75244]:   <features>
Nov 29 23:14:56 user nova-compute[75244]:     <acpi/>
Nov 29 23:14:56 user nova-compute[75244]:     <apic/>
Nov 29 23:14:56 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:14:56 user nova-compute[75244]:   </features>
Nov 29 23:14:56 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:14:56 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:14:56 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:14:56 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:14:56 user nova-compute[75244]:   </clock>
Nov 29 23:14:56 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:14:56 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:14:56 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:14:56 user nova-compute[75244]:   </cpu>
Nov 29 23:14:56 user nova-compute[75244]:   <devices>
Nov 29 23:14:56 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:14:56 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:14:56 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk"/>
Nov 29 23:14:56 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:14:56 user nova-compute[75244]:     </disk>
Nov 29 23:14:56 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:14:56 user nova-compute[75244]:       <mac address="fa:16:3e:99:6a:7d"/>
Nov 29 23:14:56 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:14:56 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:14:56 user nova-compute[75244]:       <target dev="tap796f511a-90"/>
Nov 29 23:14:56 user nova-compute[75244]:     </interface>
Nov 29 23:14:56 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:14:56 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/console.log" append="off"/>
Nov 29 23:14:56 user nova-compute[75244]:     </serial>
Nov 29 23:14:56 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:14:56 user nova-compute[75244]:     <video>
Nov 29 23:14:56 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:14:56 user nova-compute[75244]:     </video>
Nov 29 23:14:56 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:14:56 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:14:56 user nova-compute[75244]:     </rng>
Nov 29 23:14:56 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:14:56 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:14:56 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:14:56 user nova-compute[75244]:     </memballoon>
Nov 29 23:14:56 user nova-compute[75244]:   </devices>
Nov 29 23:14:56 user nova-compute[75244]: </domain>
Nov 29 23:14:56 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1643090801',display_name='tempest-tempest.common.compute-instance-1643090801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1643090801',id=29,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErh/VToo0qYK6+7fEb47QasHwkBDh/Di7DcZqgW5G5XcHJcicmvkwPEc73bpsWhk53vBOdaarefC0jqkVt2PY7VV6Oq48EkCO2rbi5COodppn+fElofB2+D+fgtpAooDw==',key_name='tempest-keypair-1881256599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-6bytho4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1bac525e-daeb-49d9-a4bc-96bf5bd2543d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG os_vif [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6478c6-e70a-5bbf-bd1c-ddee0da084ed', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap796f511a-90, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap796f511a-90, col_values=(('qos', UUID('8e987717-7ed3-4678-93a7-58cdd7b914b0')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap796f511a-90, col_values=(('external_ids', {'iface-id': '796f511a-90e8-4b6f-8bc0-25ed0d7fff0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:6a:7d', 'vm-uuid': '1bac525e-daeb-49d9-a4bc-96bf5bd2543d'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:56 user nova-compute[75244]: INFO os_vif [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90')
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No VIF found with MAC fa:16:3e:99:6a:7d, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:56 user nova-compute[75244]: INFO nova.compute.manager [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Took 0.79 seconds to detach 1 volumes for instance.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Deleting volume: 8cf0e830-0613-46a9-badd-bca0a18cd8af {{(pid=75244) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 23:14:56 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Took 1.68 seconds to deallocate network for instance.
Nov 29 23:14:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26562653761343434', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562653761343434', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:14:56 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:14:56 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:14:56 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:14:56 user nova-compute[75244]:   <serial>b42502d3-687a-4237-931f-d362c357bb6c</serial>
Nov 29 23:14:56 user nova-compute[75244]: </disk>
Nov 29 23:14:56 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:14:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updated VIF entry in instance network info cache for port 796f511a-90e8-4b6f-8bc0-25ed0d7fff0f. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updating instance_info_cache with network_info: [{"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5b055e7d-503f-4997-803d-141d0cb3c1ed req-667a222d-04a7-4da0-911d-b9cfe73f1c5a service nova] Releasing lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.381s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:57 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Deleted allocations for instance 24054fdc-8f5e-4352-bdfa-717f288152bf
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15083dab-9a8e-4783-b05f-c6edfaa322d7 tempest-AttachVolumeShelveTestJSON-576906296 tempest-AttachVolumeShelveTestJSON-576906296-project-member] Lock "24054fdc-8f5e-4352-bdfa-717f288152bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.471s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] No VIF found with MAC fa:16:3e:38:e3:92, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:57 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Deleted allocations for instance 089b181a-b746-4a25-94ad-50fd268a7cd9
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a9e60ccf-cdd0-4c08-b01b-1c77118362d7 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.828s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-3408654f-1082-49ee-9e0a-697fc1e14f9c req-ba33b17a-f405-4db3-9fcc-6c95c49a0c94 service nova] [instance: 089b181a-b746-4a25-94ad-50fd268a7cd9] Received event network-vif-deleted-cb3b5745-668b-43f3-a685-d55bbd873b3e {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-87a7b420-6193-4191-95f2-07ba1d8244b6 tempest-TestShelveInstance-1542675207 tempest-TestShelveInstance-1542675207-project-member] Lock "089b181a-b746-4a25-94ad-50fd268a7cd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.048s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-158d3c8c-fc5a-404b-8fe5-8311f1ed05df req-eb8949fc-728a-4f64-a126-631c33fed36b service nova] [instance: 24054fdc-8f5e-4352-bdfa-717f288152bf] Received event network-vif-deleted-e96d8f49-a385-4553-805a-a353f62944ac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:58 user nova-compute[75244]: INFO nova.compute.manager [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Detaching volume 5dbd20b0-3adc-42bd-ba87-6848070a0b73
Nov 29 23:14:58 user nova-compute[75244]: INFO nova.virt.block_device [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attempting to driver detach volume 5dbd20b0-3adc-42bd-ba87-6848070a0b73 from mountpoint /dev/vdb
Nov 29 23:14:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Attempting to detach device vdb from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:14:58 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:14:58 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:14:58 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:14:58 user nova-compute[75244]:   <serial>5dbd20b0-3adc-42bd-ba87-6848070a0b73</serial>
Nov 29 23:14:58 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:14:58 user nova-compute[75244]: </disk>
Nov 29 23:14:58 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:14:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully detached device vdb from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the persistent domain config.
Nov 29 23:14:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:14:58 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:14:58 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:14:58 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:14:58 user nova-compute[75244]:   <serial>5dbd20b0-3adc-42bd-ba87-6848070a0b73</serial>
Nov 29 23:14:58 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:14:58 user nova-compute[75244]: </disk>
Nov 29 23:14:58 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:14:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:59 user nova-compute[75244]: WARNING nova.compute.manager [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state building and task_state spawning.
Nov 29 23:14:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:14:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:14:59 user nova-compute[75244]: WARNING nova.compute.manager [req-e2ae08ca-0073-48ea-97d6-5b2292264a88 req-0fda6966-6209-43fc-beb1-38f213773b2e service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state building and task_state spawning.
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:15:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance spawned successfully.
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:00 user nova-compute[75244]: INFO nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 29 23:15:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:15:00 user nova-compute[75244]: INFO nova.compute.manager [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Took 8.51 seconds to build instance.
Nov 29 23:15:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dbcb3969-384f-4ce2-9276-cc48b791d0b6 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.630s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Port beb2df2b-5192-4d17-8e62-09c480ce6e36 binding to destination host user is already ACTIVE {{(pid=75244) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Creating tmpfile /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/tmpyrz5auk8 to verify with other compute node that the instance is on the same shared storage. {{(pid=75244) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 23:15:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-6c9f884c-b150-40b1-bd77-f36204042a06 req-583939dc-1ea2-4a4e-a6e1-e0a91434ad87 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6c9f884c-b150-40b1-bd77-f36204042a06 req-583939dc-1ea2-4a4e-a6e1-e0a91434ad87 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6c9f884c-b150-40b1-bd77-f36204042a06 req-583939dc-1ea2-4a4e-a6e1-e0a91434ad87 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6c9f884c-b150-40b1-bd77-f36204042a06 req-583939dc-1ea2-4a4e-a6e1-e0a91434ad87 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-6c9f884c-b150-40b1-bd77-f36204042a06 req-583939dc-1ea2-4a4e-a6e1-e0a91434ad87 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:02 user nova-compute[75244]: WARNING nova.compute.manager [req-6c9f884c-b150-40b1-bd77-f36204042a06 req-583939dc-1ea2-4a4e-a6e1-e0a91434ad87 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state resized and task_state resize_reverting.
Nov 29 23:15:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance destroyed successfully.
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.objects.instance [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'resources' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:13:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:13:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeb2df2b-51, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46383606-6afa-419e-9b3c-9a27c4da2ea0) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:02 user nova-compute[75244]: INFO os_vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51')
Nov 29 23:15:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:02 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af6fc8-a464-47e4-b8ae-5644c2e29efa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:15:02 user nova-compute[75244]: No targets found.
Nov 29 23:15:02 user nova-compute[75244]: iSNS:
Nov 29 23:15:02 user nova-compute[75244]: No targets found.
Nov 29 23:15:02 user nova-compute[75244]: STATIC:
Nov 29 23:15:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:15:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73
Nov 29 23:15:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:15:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c
Nov 29 23:15:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:02 user nova-compute[75244]: FIRMWARE:
Nov 29 23:15:02 user nova-compute[75244]: No targets found.
Nov 29 23:15:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:15:02 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:15:02 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02df50c-6a80-42b7-b1fc-bdc49788149d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8239f00c-6ba3-4a79-8c54-757cffdea47d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:02 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:02 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:02 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:02 user nova-compute[75244]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:02 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:02 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80438f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc3428-2591-4627-add6-9dbba1c2cc75]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdd61e9-0769-4ee6-a644-87786ea82dc5]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[49689174-2f62-4054-b7a1-bebde5140ef0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69a031-4d1c-42d3-b06d-4775064f1c60]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d759f0e6-5e3c-4ebd-8f4a-ddb783fca577]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14864c8d-a62b-4a36-a1ba-675c1ebf8b14]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]
Nov 29 23:15:03 user nova-compute[75244]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:15:03 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a272ef8-26a7-421c-b420-405982915d52]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== disconnect_volume: return (353ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:15:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'migration_context' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.objects.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Object Instance<7156169f-5668-49cb-93dc-35009dfff4c4> lazy-loaded attributes: resources,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-48d447eb-ad7d-4336-8791-d4fdd1ac22a4 req-ed07006a-f3e3-43a9-9867-2a44fa6da2e4 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-48d447eb-ad7d-4336-8791-d4fdd1ac22a4 req-ed07006a-f3e3-43a9-9867-2a44fa6da2e4 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-48d447eb-ad7d-4336-8791-d4fdd1ac22a4 req-ed07006a-f3e3-43a9-9867-2a44fa6da2e4 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-48d447eb-ad7d-4336-8791-d4fdd1ac22a4 req-ed07006a-f3e3-43a9-9867-2a44fa6da2e4 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-48d447eb-ad7d-4336-8791-d4fdd1ac22a4 req-ed07006a-f3e3-43a9-9867-2a44fa6da2e4 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:04 user nova-compute[75244]: WARNING nova.compute.manager [req-48d447eb-ad7d-4336-8791-d4fdd1ac22a4 req-ed07006a-f3e3-43a9-9867-2a44fa6da2e4 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state resized and task_state resize_reverting.
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.410s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:04 user nova-compute[75244]: INFO nova.compute.manager [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Swapping old allocation on dict_keys(['cc9d5100-ee82-415a-9911-9d1a045bcd6b']) held by migration c5765990-1530-4271-90e1-a87af20101e3 for instance
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Overwriting current allocation {'allocations': {'cc9d5100-ee82-415a-9911-9d1a045bcd6b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 36}}, 'project_id': 'e2752170d04b4e3da54e0f7aa8d57e94', 'user_id': '579c42ce8eec4d1da0554d4797bde030', 'consumer_generation': 1} on consumer 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquired lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Releasing lock "refresh_cache-7156169f-5668-49cb-93dc-35009dfff4c4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG os_brick.utils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ee1b9-e9a4-4e24-b639-0a395507e925]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4761ab4e-5e26-4d50-a1e1-ec0e0a464c01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fff414-eaa4-4173-a066-e1779d20edb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f803440-1aff-45e7-b1d5-a4b66813ded0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:15:05 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:15:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9844ed9e-8db3-4b33-b56a-32b45e232708]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG os_brick.utils [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Starting finish_revert_migration {{(pid=75244) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start _get_guest_xml network_info=[{"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7156169f-5668-49cb-93dc-35009dfff4c4', 'attached_at': '2023-11-29T23:15:14.000000', 'detached_at': '', 'volume_id': 'ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'serial': 'ed984e2b-1b00-4864-80a3-22b6d3092a3c'}, 'attachment_id': 'd43d4247-df07-42d3-9b02-47d961126334', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:15:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:13 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0c7738-7005-492b-9e4d-7706dfb7a0fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:15:13 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8c4a60-58fe-4b02-b063-049131d18be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c] added
Nov 29 23:15:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a33ad1-0527-4824-bdc1-56bb55e6be9b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7bf021-a175-4d4b-99c5-3107df036b7c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQwCaIxg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQwCaIxg" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ccbfc7-59f6-4264-8c1b-5b812edda034]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQwCaIxg'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393911f-d8c8-4275-b543-0f58eda33bc1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f80e69-6476-4d0b-842f-b0beaec0a328]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:13 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:13 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:13 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:13 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f3c028-4556-4815-97fe-045758c44851]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]
Nov 29 23:15:14 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:15:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[482d5ced-fb16-4501-b04a-acc44be2f50f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58238e9-a043-472e-a61f-87b5a96ba2a3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:14 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:14 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:14 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:14 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:14 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:14 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab7e663-040d-4686-9d75-9cccda1c2e3e]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:15:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26333363139636234', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363139636234', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:13:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:15:15 user nova-compute[75244]:   <uuid>7156169f-5668-49cb-93dc-35009dfff4c4</uuid>
Nov 29 23:15:15 user nova-compute[75244]:   <name>instance-00000015</name>
Nov 29 23:15:15 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:15:15 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:15:15 user nova-compute[75244]:   <metadata>
Nov 29 23:15:15 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:15:15 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:15:15 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherB-server-986679095</nova:name>
Nov 29 23:15:15 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:15:13</nova:creationTime>
Nov 29 23:15:15 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:15:15 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:15:15 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:15:15 user nova-compute[75244]:       <nova:owner>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:user uuid="579c42ce8eec4d1da0554d4797bde030">tempest-ServerActionsTestOtherB-1460963367-project-member</nova:user>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:project uuid="e2752170d04b4e3da54e0f7aa8d57e94">tempest-ServerActionsTestOtherB-1460963367</nova:project>
Nov 29 23:15:15 user nova-compute[75244]:       </nova:owner>
Nov 29 23:15:15 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:15:15 user nova-compute[75244]:       <nova:ports>
Nov 29 23:15:15 user nova-compute[75244]:         <nova:port uuid="beb2df2b-5192-4d17-8e62-09c480ce6e36">
Nov 29 23:15:15 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:15:15 user nova-compute[75244]:         </nova:port>
Nov 29 23:15:15 user nova-compute[75244]:       </nova:ports>
Nov 29 23:15:15 user nova-compute[75244]:     </nova:instance>
Nov 29 23:15:15 user nova-compute[75244]:   </metadata>
Nov 29 23:15:15 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:15:15 user nova-compute[75244]:     <system>
Nov 29 23:15:15 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:15:15 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:15:15 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:15:15 user nova-compute[75244]:       <entry name="serial">7156169f-5668-49cb-93dc-35009dfff4c4</entry>
Nov 29 23:15:15 user nova-compute[75244]:       <entry name="uuid">7156169f-5668-49cb-93dc-35009dfff4c4</entry>
Nov 29 23:15:15 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:15:15 user nova-compute[75244]:     </system>
Nov 29 23:15:15 user nova-compute[75244]:   </sysinfo>
Nov 29 23:15:15 user nova-compute[75244]:   <os>
Nov 29 23:15:15 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:15:15 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:15:15 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:15:15 user nova-compute[75244]:   </os>
Nov 29 23:15:15 user nova-compute[75244]:   <features>
Nov 29 23:15:15 user nova-compute[75244]:     <acpi/>
Nov 29 23:15:15 user nova-compute[75244]:     <apic/>
Nov 29 23:15:15 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:15:15 user nova-compute[75244]:   </features>
Nov 29 23:15:15 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:15:15 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:15:15 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:15:15 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:15:15 user nova-compute[75244]:   </clock>
Nov 29 23:15:15 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:15:15 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:15:15 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:15:15 user nova-compute[75244]:   </cpu>
Nov 29 23:15:15 user nova-compute[75244]:   <devices>
Nov 29 23:15:15 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:15:15 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:15:15 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk"/>
Nov 29 23:15:15 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:15:15 user nova-compute[75244]:     </disk>
Nov 29 23:15:15 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:15:15 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:15:15 user nova-compute[75244]:       <source dev="/dev/sde"/>
Nov 29 23:15:15 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:15:15 user nova-compute[75244]:       <serial>ed984e2b-1b00-4864-80a3-22b6d3092a3c</serial>
Nov 29 23:15:15 user nova-compute[75244]:     </disk>
Nov 29 23:15:15 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:15:15 user nova-compute[75244]:       <mac address="fa:16:3e:79:3f:62"/>
Nov 29 23:15:15 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:15 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:15:15 user nova-compute[75244]:       <target dev="tapbeb2df2b-51"/>
Nov 29 23:15:15 user nova-compute[75244]:     </interface>
Nov 29 23:15:15 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:15:15 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/console.log" append="off"/>
Nov 29 23:15:15 user nova-compute[75244]:     </serial>
Nov 29 23:15:15 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:15:15 user nova-compute[75244]:     <video>
Nov 29 23:15:15 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:15 user nova-compute[75244]:     </video>
Nov 29 23:15:15 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:15:15 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:15:15 user nova-compute[75244]:     </rng>
Nov 29 23:15:15 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:15:15 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:15:15 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:15:15 user nova-compute[75244]:     </memballoon>
Nov 29 23:15:15 user nova-compute[75244]:   </devices>
Nov 29 23:15:15 user nova-compute[75244]: </domain>
Nov 29 23:15:15 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:13:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG os_vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5342bdf7-4f4b-5008-a689-b0c8ce1a60f9', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeb2df2b-51, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbeb2df2b-51, col_values=(('qos', UUID('7ce3280a-8361-406b-80d1-fc418accfd43')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbeb2df2b-51, col_values=(('external_ids', {'iface-id': 'beb2df2b-5192-4d17-8e62-09c480ce6e36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:3f:62', 'vm-uuid': '7156169f-5668-49cb-93dc-35009dfff4c4'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:15 user nova-compute[75244]: INFO os_vif [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51')
Nov 29 23:15:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-d8ca2a64-8473-40ea-a9ba-79714c798619 req-33939591-8039-4e3d-a0e3-e901afcfe6d9 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d8ca2a64-8473-40ea-a9ba-79714c798619 req-33939591-8039-4e3d-a0e3-e901afcfe6d9 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d8ca2a64-8473-40ea-a9ba-79714c798619 req-33939591-8039-4e3d-a0e3-e901afcfe6d9 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d8ca2a64-8473-40ea-a9ba-79714c798619 req-33939591-8039-4e3d-a0e3-e901afcfe6d9 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-d8ca2a64-8473-40ea-a9ba-79714c798619 req-33939591-8039-4e3d-a0e3-e901afcfe6d9 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:16 user nova-compute[75244]: WARNING nova.compute.manager [req-d8ca2a64-8473-40ea-a9ba-79714c798619 req-33939591-8039-4e3d-a0e3-e901afcfe6d9 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state resized and task_state resize_reverting.
Nov 29 23:15:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:15:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance running successfully.
Nov 29 23:15:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] finish_revert_migration finished successfully. {{(pid=75244) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-4e2df18d-a6a4-40ae-864a-22cc7ad7ae4d req-78ac136f-f07c-4cc1-8af5-110a71e594f2 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4e2df18d-a6a4-40ae-864a-22cc7ad7ae4d req-78ac136f-f07c-4cc1-8af5-110a71e594f2 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4e2df18d-a6a4-40ae-864a-22cc7ad7ae4d req-78ac136f-f07c-4cc1-8af5-110a71e594f2 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4e2df18d-a6a4-40ae-864a-22cc7ad7ae4d req-78ac136f-f07c-4cc1-8af5-110a71e594f2 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-4e2df18d-a6a4-40ae-864a-22cc7ad7ae4d req-78ac136f-f07c-4cc1-8af5-110a71e594f2 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:18 user nova-compute[75244]: WARNING nova.compute.manager [req-4e2df18d-a6a4-40ae-864a-22cc7ad7ae4d req-78ac136f-f07c-4cc1-8af5-110a71e594f2 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state resized and task_state resize_reverting.
Nov 29 23:15:18 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 is timed out.
Nov 29 23:15:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully detached device vdb from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the live domain config.
Nov 29 23:15:18 user nova-compute[75244]: INFO nova.compute.manager [None req-23ee8ce5-0210-4ca3-a80b-264c5a19fdc7 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance to original state: 'active'
Nov 29 23:15:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnlbvdWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:18 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ced947-06f4-458f-8ecc-b59b45558ba7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:15:18 user nova-compute[75244]: No targets found.
Nov 29 23:15:18 user nova-compute[75244]: iSNS:
Nov 29 23:15:18 user nova-compute[75244]: No targets found.
Nov 29 23:15:18 user nova-compute[75244]: STATIC:
Nov 29 23:15:18 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:15:18 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:18 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:18 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73
Nov 29 23:15:18 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:18 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:18 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:15:18 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:18 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:18 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c
Nov 29 23:15:18 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:18 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:18 user nova-compute[75244]: FIRMWARE:
Nov 29 23:15:18 user nova-compute[75244]: No targets found.
Nov 29 23:15:18 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:15:18 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:15:18 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6149e2-bae2-4283-b6eb-5c685ab95d45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b83be-b29e-4e42-b328-7e36bcb14e16]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:18 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:18 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:18 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:18 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:18 user nova-compute[75244]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 (non-flash)
Nov 29 23:15:18 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:18 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:18 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043df520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:15:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622a909-ebb0-422a-96de-398eb70830bf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b537cf-b44e-401f-82a7-7c17c701ce29]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f34145d-cfe7-48db-81fd-355b32b85d9a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b25860-8d29-422e-b77e-7f8244fdaf59]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.071s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a17b9b-824c-4eb6-a870-1f19df419e79]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:15:19 user nova-compute[75244]: INFO nova.compute.claims [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Claim successful on node user
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[81059d91-d0a0-4961-b879-e9522635338f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260]
Nov 29 23:15:19 user nova-compute[75244]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73, portal: 172.16.0.220,3260] successful.
Nov 29 23:15:19 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbd20b0-3adc-42bd-ba87-6848070a0b73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0b5823-8e2c-41c3-be7f-72569a411023]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== disconnect_volume: return (381ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:15:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.policy [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbdba67b1fdb470194c5a15ee3c4baee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f830c5f8f3641f1938b103eae582ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:15:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Creating image(s)
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "/opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "/opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk 1073741824" returned: 0 in 0.049s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Successfully created port: 4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Cannot resize image /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Ensure instance console log exists: /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Successfully updated port: 4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquired lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-changed-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Refreshing instance network info cache due to event network-changed-4d6d1a11-8d34-413f-ae0f-b304f2812e38. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] Acquiring lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updating instance_info_cache with network_info: [{"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Releasing lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Instance network_info: |[{"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] Acquired lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.neutron [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Refreshing network info cache for port 4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Start _get_guest_xml network_info=[{"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:15:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1845313309',display_name='tempest-AttachVolumeNegativeTest-server-1845313309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1845313309',id=30,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPwgv3R1FgYLMCU4DYyt7XLaPGUMuqzPp7HIlcM2fQ1IfCY3oHZh5Kh6G1d4fXTO1WoSCSdtk3/Ei21+H/5ozzAzNzBY6fflQnYP0p7DZR9Lj17zH8Jp4POAtDsmZkJvA==',key_name='tempest-keypair-1159852033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-v61959fi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=7acb45a6-a508-423e-9b1f-b93a29ab5da9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'pci_devices' on Instance uuid 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:15:21 user nova-compute[75244]:   <uuid>7acb45a6-a508-423e-9b1f-b93a29ab5da9</uuid>
Nov 29 23:15:21 user nova-compute[75244]:   <name>instance-0000001e</name>
Nov 29 23:15:21 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:15:21 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:15:21 user nova-compute[75244]:   <metadata>
Nov 29 23:15:21 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:15:21 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:15:21 user nova-compute[75244]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1845313309</nova:name>
Nov 29 23:15:21 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:15:21</nova:creationTime>
Nov 29 23:15:21 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:15:21 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:15:21 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:15:21 user nova-compute[75244]:       <nova:owner>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:user uuid="dbdba67b1fdb470194c5a15ee3c4baee">tempest-AttachVolumeNegativeTest-750809743-project-member</nova:user>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:project uuid="2f830c5f8f3641f1938b103eae582ccd">tempest-AttachVolumeNegativeTest-750809743</nova:project>
Nov 29 23:15:21 user nova-compute[75244]:       </nova:owner>
Nov 29 23:15:21 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:15:21 user nova-compute[75244]:       <nova:ports>
Nov 29 23:15:21 user nova-compute[75244]:         <nova:port uuid="4d6d1a11-8d34-413f-ae0f-b304f2812e38">
Nov 29 23:15:21 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 23:15:21 user nova-compute[75244]:         </nova:port>
Nov 29 23:15:21 user nova-compute[75244]:       </nova:ports>
Nov 29 23:15:21 user nova-compute[75244]:     </nova:instance>
Nov 29 23:15:21 user nova-compute[75244]:   </metadata>
Nov 29 23:15:21 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:15:21 user nova-compute[75244]:     <system>
Nov 29 23:15:21 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:15:21 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:15:21 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:15:21 user nova-compute[75244]:       <entry name="serial">7acb45a6-a508-423e-9b1f-b93a29ab5da9</entry>
Nov 29 23:15:21 user nova-compute[75244]:       <entry name="uuid">7acb45a6-a508-423e-9b1f-b93a29ab5da9</entry>
Nov 29 23:15:21 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:15:21 user nova-compute[75244]:     </system>
Nov 29 23:15:21 user nova-compute[75244]:   </sysinfo>
Nov 29 23:15:21 user nova-compute[75244]:   <os>
Nov 29 23:15:21 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:15:21 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:15:21 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:15:21 user nova-compute[75244]:   </os>
Nov 29 23:15:21 user nova-compute[75244]:   <features>
Nov 29 23:15:21 user nova-compute[75244]:     <acpi/>
Nov 29 23:15:21 user nova-compute[75244]:     <apic/>
Nov 29 23:15:21 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:15:21 user nova-compute[75244]:   </features>
Nov 29 23:15:21 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:15:21 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:15:21 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:15:21 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:15:21 user nova-compute[75244]:   </clock>
Nov 29 23:15:21 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:15:21 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:15:21 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:15:21 user nova-compute[75244]:   </cpu>
Nov 29 23:15:21 user nova-compute[75244]:   <devices>
Nov 29 23:15:21 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:15:21 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:15:21 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk"/>
Nov 29 23:15:21 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:15:21 user nova-compute[75244]:     </disk>
Nov 29 23:15:21 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:15:21 user nova-compute[75244]:       <mac address="fa:16:3e:2f:ef:7a"/>
Nov 29 23:15:21 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:21 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:15:21 user nova-compute[75244]:       <target dev="tap4d6d1a11-8d"/>
Nov 29 23:15:21 user nova-compute[75244]:     </interface>
Nov 29 23:15:21 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:15:21 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/console.log" append="off"/>
Nov 29 23:15:21 user nova-compute[75244]:     </serial>
Nov 29 23:15:21 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:15:21 user nova-compute[75244]:     <video>
Nov 29 23:15:21 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:21 user nova-compute[75244]:     </video>
Nov 29 23:15:21 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:15:21 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:15:21 user nova-compute[75244]:     </rng>
Nov 29 23:15:21 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:15:21 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:15:21 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:15:21 user nova-compute[75244]:     </memballoon>
Nov 29 23:15:21 user nova-compute[75244]:   </devices>
Nov 29 23:15:21 user nova-compute[75244]: </domain>
Nov 29 23:15:21 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1845313309',display_name='tempest-AttachVolumeNegativeTest-server-1845313309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1845313309',id=30,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPwgv3R1FgYLMCU4DYyt7XLaPGUMuqzPp7HIlcM2fQ1IfCY3oHZh5Kh6G1d4fXTO1WoSCSdtk3/Ei21+H/5ozzAzNzBY6fflQnYP0p7DZR9Lj17zH8Jp4POAtDsmZkJvA==',key_name='tempest-keypair-1159852033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-v61959fi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=7acb45a6-a508-423e-9b1f-b93a29ab5da9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG os_vif [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '853fb08a-769a-570a-8fbe-8ab4460af9ed', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d6d1a11-8d, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d6d1a11-8d, col_values=(('qos', UUID('2967f3f3-c16d-4ead-843c-ae83de4fc3be')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d6d1a11-8d, col_values=(('external_ids', {'iface-id': '4d6d1a11-8d34-413f-ae0f-b304f2812e38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:ef:7a', 'vm-uuid': '7acb45a6-a508-423e-9b1f-b93a29ab5da9'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:21 user nova-compute[75244]: INFO os_vif [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d')
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:2f:ef:7a, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:15:22 user nova-compute[75244]: DEBUG nova.network.neutron [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updated VIF entry in instance network info cache for port 4d6d1a11-8d34-413f-ae0f-b304f2812e38. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:15:22 user nova-compute[75244]: DEBUG nova.network.neutron [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updating instance_info_cache with network_info: [{"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-66f6612f-c808-4464-baa3-2b441405b020 req-0afdb769-4f01-49de-8c73-a96120893f86 service nova] Releasing lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-1f283961-b4e9-406a-aa58-4e1666f864d9 req-b335e574-1dc6-4788-8fe8-7f49d3151e8d service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1f283961-b4e9-406a-aa58-4e1666f864d9 req-b335e574-1dc6-4788-8fe8-7f49d3151e8d service nova] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1f283961-b4e9-406a-aa58-4e1666f864d9 req-b335e574-1dc6-4788-8fe8-7f49d3151e8d service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1f283961-b4e9-406a-aa58-4e1666f864d9 req-b335e574-1dc6-4788-8fe8-7f49d3151e8d service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-1f283961-b4e9-406a-aa58-4e1666f864d9 req-b335e574-1dc6-4788-8fe8-7f49d3151e8d service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] No waiting events found dispatching network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:23 user nova-compute[75244]: WARNING nova.compute.manager [req-1f283961-b4e9-406a-aa58-4e1666f864d9 req-b335e574-1dc6-4788-8fe8-7f49d3151e8d service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received unexpected event network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 for instance with vm_state building and task_state spawning.
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:24 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7ee09a97-1834-4f44-bb30-369954ebf611 tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.421s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:25 user nova-compute[75244]: INFO nova.compute.manager [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Detaching volume b42502d3-687a-4237-931f-d362c357bb6c
Nov 29 23:15:25 user nova-compute[75244]: INFO nova.virt.block_device [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Attempting to driver detach volume b42502d3-687a-4237-931f-d362c357bb6c from mountpoint /dev/vdc
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Attempting to detach device vdc from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:15:25 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:15:25 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:15:25 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:15:25 user nova-compute[75244]:   <serial>b42502d3-687a-4237-931f-d362c357bb6c</serial>
Nov 29 23:15:25 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 23:15:25 user nova-compute[75244]: </disk>
Nov 29 23:15:25 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:15:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully detached device vdc from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the persistent domain config.
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:15:25 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:15:25 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:15:25 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:15:25 user nova-compute[75244]:   <serial>b42502d3-687a-4237-931f-d362c357bb6c</serial>
Nov 29 23:15:25 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 23:15:25 user nova-compute[75244]: </disk>
Nov 29 23:15:25 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:15:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Instance spawned successfully.
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-b2cc31d6-f334-40a6-abaa-1a80606bf06f req-79a225fc-af45-4b9d-b96c-64e7be7d25d3 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b2cc31d6-f334-40a6-abaa-1a80606bf06f req-79a225fc-af45-4b9d-b96c-64e7be7d25d3 service nova] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b2cc31d6-f334-40a6-abaa-1a80606bf06f req-79a225fc-af45-4b9d-b96c-64e7be7d25d3 service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b2cc31d6-f334-40a6-abaa-1a80606bf06f req-79a225fc-af45-4b9d-b96c-64e7be7d25d3 service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-b2cc31d6-f334-40a6-abaa-1a80606bf06f req-79a225fc-af45-4b9d-b96c-64e7be7d25d3 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] No waiting events found dispatching network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:25 user nova-compute[75244]: WARNING nova.compute.manager [req-b2cc31d6-f334-40a6-abaa-1a80606bf06f req-79a225fc-af45-4b9d-b96c-64e7be7d25d3 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received unexpected event network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 for instance with vm_state building and task_state spawning.
Nov 29 23:15:25 user nova-compute[75244]: INFO nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:15:25 user nova-compute[75244]: INFO nova.compute.manager [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Took 6.61 seconds to build instance.
Nov 29 23:15:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-af811e28-a954-48e1-a026-c6ed0b69b7c6 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.719s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:15:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG nova.objects.instance [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'flavor' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:29 user nova-compute[75244]: INFO nova.compute.manager [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Attaching volume d3f9d21d-8d4b-45af-8e1a-34af33996800 to /dev/vdb
Nov 29 23:15:29 user nova-compute[75244]: DEBUG os_brick.utils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb375a3-a4cf-40ca-9a6e-bed2e2accf22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab4931-9180-470c-a366-7e6b9a9466df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eab87b-d6e5-4c8d-aa3b-6dda33700e70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565ec1c-fc1f-41a1-b584-190feef16914]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:15:29 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:15:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f61dbeb-2ed2-4ac4-8946-88b9143299e2]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:15:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG os_brick.utils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating existing volume attachment record: 56fc9ce4-2a44-4183-a778-054aeab587f0 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:15:30 user nova-compute[75244]: INFO nova.compute.claims [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Claim successful on node user
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:15:30 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:15:30 user nova-compute[75244]: DEBUG nova.policy [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2a16d9d8a414de4b6621acd12b89aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9595b50731fc44ae85e99ded8dbbaf61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:15:31 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Creating image(s)
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk 1073741824" returned: 0 in 0.050s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.274s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Successfully created port: d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Cannot resize image /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Successfully updated port: d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-changed-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Refreshing instance network info cache due to event network-changed-d4bee46e-259a-44ed-ac7b-5b81488002f0. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] Acquiring lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updating instance_info_cache with network_info: [{"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Instance network_info: |[{"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] Acquired lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.neutron [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Refreshing network info cache for port d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Start _get_guest_xml network_info=[{"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:15:32 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:32 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652482759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652482759',id=31,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-0uvje3ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:15:31Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.objects.instance [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:15:32 user nova-compute[75244]:   <uuid>0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd</uuid>
Nov 29 23:15:32 user nova-compute[75244]:   <name>instance-0000001f</name>
Nov 29 23:15:32 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:15:32 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:15:32 user nova-compute[75244]:   <metadata>
Nov 29 23:15:32 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:15:32 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:15:32 user nova-compute[75244]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1652482759</nova:name>
Nov 29 23:15:32 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:15:32</nova:creationTime>
Nov 29 23:15:32 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:15:32 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:15:32 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:15:32 user nova-compute[75244]:       <nova:owner>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:user uuid="c2a16d9d8a414de4b6621acd12b89aa0">tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member</nova:user>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:project uuid="9595b50731fc44ae85e99ded8dbbaf61">tempest-ServerBootFromVolumeStableRescueTest-1262475948</nova:project>
Nov 29 23:15:32 user nova-compute[75244]:       </nova:owner>
Nov 29 23:15:32 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:15:32 user nova-compute[75244]:       <nova:ports>
Nov 29 23:15:32 user nova-compute[75244]:         <nova:port uuid="d4bee46e-259a-44ed-ac7b-5b81488002f0">
Nov 29 23:15:32 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:15:32 user nova-compute[75244]:         </nova:port>
Nov 29 23:15:32 user nova-compute[75244]:       </nova:ports>
Nov 29 23:15:32 user nova-compute[75244]:     </nova:instance>
Nov 29 23:15:32 user nova-compute[75244]:   </metadata>
Nov 29 23:15:32 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:15:32 user nova-compute[75244]:     <system>
Nov 29 23:15:32 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:15:32 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:15:32 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:15:32 user nova-compute[75244]:       <entry name="serial">0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd</entry>
Nov 29 23:15:32 user nova-compute[75244]:       <entry name="uuid">0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd</entry>
Nov 29 23:15:32 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:15:32 user nova-compute[75244]:     </system>
Nov 29 23:15:32 user nova-compute[75244]:   </sysinfo>
Nov 29 23:15:32 user nova-compute[75244]:   <os>
Nov 29 23:15:32 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:15:32 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:15:32 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:15:32 user nova-compute[75244]:   </os>
Nov 29 23:15:32 user nova-compute[75244]:   <features>
Nov 29 23:15:32 user nova-compute[75244]:     <acpi/>
Nov 29 23:15:32 user nova-compute[75244]:     <apic/>
Nov 29 23:15:32 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:15:32 user nova-compute[75244]:   </features>
Nov 29 23:15:32 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:15:32 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:15:32 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:15:32 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:15:32 user nova-compute[75244]:   </clock>
Nov 29 23:15:32 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:15:32 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:15:32 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:15:32 user nova-compute[75244]:   </cpu>
Nov 29 23:15:32 user nova-compute[75244]:   <devices>
Nov 29 23:15:32 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:15:32 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:15:32 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk"/>
Nov 29 23:15:32 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:15:32 user nova-compute[75244]:     </disk>
Nov 29 23:15:32 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:15:32 user nova-compute[75244]:       <mac address="fa:16:3e:90:b5:a0"/>
Nov 29 23:15:32 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:32 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:15:32 user nova-compute[75244]:       <target dev="tapd4bee46e-25"/>
Nov 29 23:15:32 user nova-compute[75244]:     </interface>
Nov 29 23:15:32 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:15:32 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/console.log" append="off"/>
Nov 29 23:15:32 user nova-compute[75244]:     </serial>
Nov 29 23:15:32 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:15:32 user nova-compute[75244]:     <video>
Nov 29 23:15:32 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:32 user nova-compute[75244]:     </video>
Nov 29 23:15:32 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:15:32 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:15:32 user nova-compute[75244]:     </rng>
Nov 29 23:15:32 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:15:32 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:15:32 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:15:32 user nova-compute[75244]:     </memballoon>
Nov 29 23:15:32 user nova-compute[75244]:   </devices>
Nov 29 23:15:32 user nova-compute[75244]: </domain>
Nov 29 23:15:32 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652482759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652482759',id=31,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-0uvje3ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:15:31Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG os_vif [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88e534cf-a005-5a58-9405-b5dba7faf412', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4bee46e-25, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4bee46e-25, col_values=(('qos', UUID('ecc99b3f-19e9-413b-95b4-f98b00a64e93')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4bee46e-25, col_values=(('external_ids', {'iface-id': 'd4bee46e-259a-44ed-ac7b-5b81488002f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:b5:a0', 'vm-uuid': '0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:15:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:32 user nova-compute[75244]: INFO os_vif [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25')
Nov 29 23:15:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No VIF found with MAC fa:16:3e:90:b5:a0, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:15:33 user nova-compute[75244]: DEBUG nova.network.neutron [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updated VIF entry in instance network info cache for port d4bee46e-259a-44ed-ac7b-5b81488002f0. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:15:33 user nova-compute[75244]: DEBUG nova.network.neutron [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updating instance_info_cache with network_info: [{"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce87ae04-65da-4158-8369-cca6e4dd07e2 req-3e82b87d-4124-4753-a849-c588d39fdeca service nova] Releasing lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-3999dbb2-e658-4dfb-8165-6f3a206236a4 req-0dbbc4b0-ce02-462a-9bb1-f0e50c2998a0 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3999dbb2-e658-4dfb-8165-6f3a206236a4 req-0dbbc4b0-ce02-462a-9bb1-f0e50c2998a0 service nova] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3999dbb2-e658-4dfb-8165-6f3a206236a4 req-0dbbc4b0-ce02-462a-9bb1-f0e50c2998a0 service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3999dbb2-e658-4dfb-8165-6f3a206236a4 req-0dbbc4b0-ce02-462a-9bb1-f0e50c2998a0 service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-3999dbb2-e658-4dfb-8165-6f3a206236a4 req-0dbbc4b0-ce02-462a-9bb1-f0e50c2998a0 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] No waiting events found dispatching network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:34 user nova-compute[75244]: WARNING nova.compute.manager [req-3999dbb2-e658-4dfb-8165-6f3a206236a4 req-0dbbc4b0-ce02-462a-9bb1-f0e50c2998a0 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received unexpected event network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 for instance with vm_state building and task_state spawning.
Nov 29 23:15:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:15:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Instance spawned successfully.
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-1527a835-f106-46b5-9b8e-512bc22a58be req-6152acbb-f477-49e3-8b31-36573f2289fa service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1527a835-f106-46b5-9b8e-512bc22a58be req-6152acbb-f477-49e3-8b31-36573f2289fa service nova] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1527a835-f106-46b5-9b8e-512bc22a58be req-6152acbb-f477-49e3-8b31-36573f2289fa service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1527a835-f106-46b5-9b8e-512bc22a58be req-6152acbb-f477-49e3-8b31-36573f2289fa service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-1527a835-f106-46b5-9b8e-512bc22a58be req-6152acbb-f477-49e3-8b31-36573f2289fa service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] No waiting events found dispatching network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:36 user nova-compute[75244]: WARNING nova.compute.manager [req-1527a835-f106-46b5-9b8e-512bc22a58be req-6152acbb-f477-49e3-8b31-36573f2289fa service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received unexpected event network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 for instance with vm_state building and task_state spawning.
Nov 29 23:15:36 user nova-compute[75244]: INFO nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:15:36 user nova-compute[75244]: INFO nova.compute.manager [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Took 6.48 seconds to build instance.
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9aae5ba4-5811-41ee-854b-ccd9ca1c2c13 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.582s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:15:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSUyOaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:39 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:39 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:39 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38b4fc-ffce-45f5-8edf-66e50f74e166]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:15:39 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[31252242-4867-430c-8756-da1ffefe8e45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800] added
Nov 29 23:15:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49bfaaf-4821-4e65-bbbd-e141a54ba85c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e075707-626b-438a-ac72-bac866d99aaf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opSUyOaM {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opSUyOaM" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf9da2-4515-43e2-8b71-b9a1273716b1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opSUyOaM'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f872fce9-0674-4450-b2ed-c8730548f604]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d1eca-8210-4d11-9dab-d41078b06b26]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fa4550-f7b9-4a82-b9c9-b77976f1be91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260]
Nov 29 23:15:39 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260] successful.
Nov 29 23:15:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15a277d-31b1-4bed-a35c-4b9dc8b1b90a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5370b367-3c45-4824-96f9-475507bce473]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:15:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:39 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:15:39 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7eb3c-93f0-4647-a003-21ecd87fc496]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:15:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSUyOaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26365663233383838', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365663233383838', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'flavor' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:15:40 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:15:40 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:15:40 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:15:40 user nova-compute[75244]:   <serial>d3f9d21d-8d4b-45af-8e1a-34af33996800</serial>
Nov 29 23:15:40 user nova-compute[75244]: </disk>
Nov 29 23:15:40 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No VIF found with MAC fa:16:3e:81:f3:0c, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:15:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-724d8bd4-13e4-4dd6-bb8e-8b03c6068d58 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.272s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:42 user nova-compute[75244]: INFO nova.compute.manager [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Rescuing
Nov 29 23:15:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:15:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:15:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:15:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:15:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:15:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-754720b0-0fb9-4c40-b3ed-9c362cec31d8 req-1f044a03-5980-4dde-af43-fc8b5f4579ee service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-754720b0-0fb9-4c40-b3ed-9c362cec31d8 req-1f044a03-5980-4dde-af43-fc8b5f4579ee service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-754720b0-0fb9-4c40-b3ed-9c362cec31d8 req-1f044a03-5980-4dde-af43-fc8b5f4579ee service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-754720b0-0fb9-4c40-b3ed-9c362cec31d8 req-1f044a03-5980-4dde-af43-fc8b5f4579ee service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-754720b0-0fb9-4c40-b3ed-9c362cec31d8 req-1f044a03-5980-4dde-af43-fc8b5f4579ee service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:43 user nova-compute[75244]: WARNING nova.compute.manager [req-754720b0-0fb9-4c40-b3ed-9c362cec31d8 req-1f044a03-5980-4dde-af43-fc8b5f4579ee service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state active and task_state rescuing.
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:15:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance destroyed successfully.
Nov 29 23:15:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Attempting a stable device rescue
Nov 29 23:15:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75244) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:15:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Creating image(s)
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "a6528f7dc60eb758b6bb08ac97b74c3e56b9a753" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "a6528f7dc60eb758b6bb08ac97b74c3e56b9a753" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 1.040s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.part --force-share --output=json" returned: 0 in 0.229s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG nova.virt.images [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] e64d105f-a97a-44f9-a722-5457d6cbf991 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.part /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-9d768e4c-4835-4991-a137-ef45d82352bd req-a082e122-52aa-43d8-9457-d4f342aeb65f service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9d768e4c-4835-4991-a137-ef45d82352bd req-a082e122-52aa-43d8-9457-d4f342aeb65f service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9d768e4c-4835-4991-a137-ef45d82352bd req-a082e122-52aa-43d8-9457-d4f342aeb65f service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9d768e4c-4835-4991-a137-ef45d82352bd req-a082e122-52aa-43d8-9457-d4f342aeb65f service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-9d768e4c-4835-4991-a137-ef45d82352bd req-a082e122-52aa-43d8-9457-d4f342aeb65f service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:45 user nova-compute[75244]: WARNING nova.compute.manager [req-9d768e4c-4835-4991-a137-ef45d82352bd req-a082e122-52aa-43d8-9457-d4f342aeb65f service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state active and task_state rescuing.
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.part /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.converted" returned: 0 in 0.411s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "a6528f7dc60eb758b6bb08ac97b74c3e56b9a753" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.946s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "a6528f7dc60eb758b6bb08ac97b74c3e56b9a753" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "a6528f7dc60eb758b6bb08ac97b74c3e56b9a753" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 is timed out.
Nov 29 23:15:45 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully detached device vdc from instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 from the live domain config.
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moDhRxri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8433b63-c25a-42fc-9cf7-4fe878c1c6f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:15:46 user nova-compute[75244]: No targets found.
Nov 29 23:15:46 user nova-compute[75244]: iSNS:
Nov 29 23:15:46 user nova-compute[75244]: No targets found.
Nov 29 23:15:46 user nova-compute[75244]: STATIC:
Nov 29 23:15:46 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:15:46 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:46 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:46 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:15:46 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:46 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:46 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:15:46 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:46 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:46 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c
Nov 29 23:15:46 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:15:46 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:15:46 user nova-compute[75244]: FIRMWARE:
Nov 29 23:15:46 user nova-compute[75244]: No targets found.
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:15:46 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:15:46 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753 --force-share --output=json" returned: 0 in 0.231s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753,backing_fmt=raw /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f300cd7f-a5d4-4381-a2dc-797cd4a7bdba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753,backing_fmt=raw /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue" returned: 0 in 0.061s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "a6528f7dc60eb758b6bb08ac97b74c3e56b9a753" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'migration_context' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Object Instance<34b60257-6546-447b-8b6d-f95eb0fdab74> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Start _get_guest_xml network_info=[{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "vif_mac": "fa:16:3e:81:f3:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e64d105f-a97a-44f9-a722-5457d6cbf991', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSUyOaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '34b60257-6546-447b-8b6d-f95eb0fdab74', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3f9d21d-8d4b-45af-8e1a-34af33996800', 'serial': 'd3f9d21d-8d4b-45af-8e1a-34af33996800'}, 'attachment_id': '56fc9ce4-2a44-4183-a778-054aeab587f0', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'resources' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcab3a-7fc5-4c85-876c-a0313348571f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80438f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Object Instance<34b60257-6546-447b-8b6d-f95eb0fdab74> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'numa_topology' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdca836-6dda-48e1-a7b3-aafa3f6ddf6f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Object Instance<34b60257-6546-447b-8b6d-f95eb0fdab74> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:46 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd4d7c6-e561-47cd-874d-1b227b83120e]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Object Instance<34b60257-6546-447b-8b6d-f95eb0fdab74> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSUyOaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:15:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fddf4a5-b649-4331-91fe-020a344730df]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec561060-2df2-42cf-ac19-7f0e8c23f5cd]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73a03f8-5e4d-4eac-914e-2ca47c383f0d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad400675-a1fe-4186-b91a-b8909317ec03]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260]
Nov 29 23:15:46 user nova-compute[75244]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c, portal: 172.16.0.220,3260] successful.
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42502d3-687a-4237-931f-d362c357bb6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6484f58b-f164-49f2-b2b9-216fb74c5f09]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.592s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] <== disconnect_volume: return (597ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.281s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:15:46 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaa1b62-8a0f-42c2-948a-04faacb53292]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = opSUyOaM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 23:15:46 user nova-compute[75244]: node.name = iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:15:46 user nova-compute[75244]: node.tpgt = -1
Nov 29 23:15:46 user nova-compute[75244]: node.startup = automatic
Nov 29 23:15:46 user nova-compute[75244]: node.leading_login = No
Nov 29 23:15:46 user nova-compute[75244]: iface.iscsi_ifacename = default
Nov 29 23:15:46 user nova-compute[75244]: iface.net_ifacename = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.ipaddress = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.prefix_len = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.hwaddress = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.transport_name = tcp
Nov 29 23:15:46 user nova-compute[75244]: iface.initiatorname = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.vlan_id = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.vlan_priority = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.vlan_state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.iface_num = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.mtu = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.port = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.bootproto = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.subnet_mask = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.gateway = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_alt_client_id = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_dns = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_learn_iqn = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_vendor_id_state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_vendor_id = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.dhcp_slp_da = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.fragmentation = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.gratuitous_arp = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.incoming_forwarding = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.tos_state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.tos = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.ttl = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.delayed_ack = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.tcp_nagle = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.tcp_wsf_state = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.tcp_wsf = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.tcp_timer_scale = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.tcp_timestamp = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.redirect = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.def_task_mgmt_timeout = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.header_digest = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.data_digest = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.immediate_data = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.initial_r2t = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.data_seq_inorder = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.data_pdu_inorder = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.erl = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.max_receive_data_len = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.first_burst_len = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.max_outstanding_r2t = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.max_burst_len = 0
Nov 29 23:15:46 user nova-compute[75244]: iface.chap_auth = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.bidi_chap = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.strict_login_compliance = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.discovery_auth = <empty>
Nov 29 23:15:46 user nova-compute[75244]: iface.discovery_logout = <empty>
Nov 29 23:15:46 user nova-compute[75244]: node.discovery_address = <empty>
Nov 29 23:15:46 user nova-compute[75244]: node.discovery_port = 0
Nov 29 23:15:46 user nova-compute[75244]: node.discovery_type = static
Nov 29 23:15:46 user nova-compute[75244]: node.session.initial_cmdsn = 0
Nov 29 23:15:46 user nova-compute[75244]: node.session.initial_login_retry_max = 8
Nov 29 23:15:46 user nova-compute[75244]: node.session.xmit_thread_priority = -20
Nov 29 23:15:46 user nova-compute[75244]: node.session.cmds_max = 128
Nov 29 23:15:46 user nova-compute[75244]: node.session.queue_depth = 32
Nov 29 23:15:46 user nova-compute[75244]: node.session.nr_sessions = 1
Nov 29 23:15:46 user nova-compute[75244]: node.session.auth.authmethod = CHAP
Nov 29 23:15:46 user nova-compute[75244]: node.session.auth.username = opSUyOaM
Nov 29 23:15:46 user nova-compute[75244]: node.session.auth.password = ***
Nov 29 23:15:46 user nova-compute[75244]: node.session.auth.username_in = <empty>
Nov 29 23:15:46 user nova-compute[75244]: node.session.auth.password_in = <empty>
Nov 29 23:15:46 user nova-compute[75244]: node.session.auth.chap_algs = MD5
Nov 29 23:15:46 user nova-compute[75244]: node.session.timeo.replacement_timeout = 120
Nov 29 23:15:46 user nova-compute[75244]: node.session.err_timeo.abort_timeout = 15
Nov 29 23:15:46 user nova-compute[75244]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 23:15:46 user nova-compute[75244]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 23:15:46 user nova-compute[75244]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.FastAbort = Yes
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.InitialR2T = No
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.ImmediateData = Yes
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.MaxConnections = 1
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 23:15:46 user nova-compute[75244]: node.session.iscsi.ERL = 0
Nov 29 23:15:46 user nova-compute[75244]: node.session.scan = manual
Nov 29 23:15:46 user nova-compute[75244]: node.session.reopen_max = 0
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].address = 172.16.0.220
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].port = 3260
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].startup = manual
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].tcp.window_size = 524288
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].tcp.type_of_service = 0
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].timeo.logout_timeout = 15
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].timeo.login_timeout = 15
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].timeo.auth_timeout = 45
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].iscsi.DataDigest = None
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].iscsi.IFMarker = No
Nov 29 23:15:46 user nova-compute[75244]: node.conn[0].iscsi.OFMarker = No
Nov 29 23:15:46 user nova-compute[75244]: # END RECORD
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff543e-4b2f-49ae-b7d0-dfed7b69a073]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1caaf05-4be0-4b8a-bf6c-d74106555172]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opSUyOaM {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opSUyOaM" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ff79b7-6ecd-4914-81ab-ca91ef520141]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opSUyOaM'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560c510-0763-4097-a125-82f97bfbd362]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed08fe-b818-4faf-81ce-f8a2594110fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:15:46 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:15:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.212s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] HCTL ('34', '0', '0', 0) found on session 37 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc7a47-b9c2-4111-9e40-ecc4ba8e03e5]: (4, ('0 0 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Searching for a device in session 37 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSUyOaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.243s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] <== connect_volume: return (524ms) {'type': 'block', 'scsi_wwn': '26365663233383838', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365663233383838', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1742931057',display_name='tempest-ServerStableDeviceRescueTest-server-1742931057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1742931057',id=27,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4iy9XOpg6wb+dg6ZZ/2USvuQHM/nvbg4P1hTn66BxDbA985JuwA6Q59dl4n8s39jN4tkY4GnppcNvcRJ2taMRdKZbqSsvx800GyTl8z+4LCC7vqSyh4wcQBO2HGSp+cw==',key_name='tempest-keypair-989750335',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cbbfa8e5fa4f18b3bcd03868aaab29',ramdisk_id='',reservation_id='r-2wc5z6sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-564661104',owner_user_name='tempest-ServerStableDeviceRescueTest-564661104-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb557daf278418793e7bb56882445f5',uuid=34b60257-6546-447b-8b6d-f95eb0fdab74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "vif_mac": "fa:16:3e:81:f3:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converting VIF {"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "vif_mac": "fa:16:3e:81:f3:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.objects.base [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Object Instance<34b60257-6546-447b-8b6d-f95eb0fdab74> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:15:46 user nova-compute[75244]:   <uuid>34b60257-6546-447b-8b6d-f95eb0fdab74</uuid>
Nov 29 23:15:46 user nova-compute[75244]:   <name>instance-0000001b</name>
Nov 29 23:15:46 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:15:46 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:15:46 user nova-compute[75244]:   <metadata>
Nov 29 23:15:46 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:15:46 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:15:46 user nova-compute[75244]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1742931057</nova:name>
Nov 29 23:15:46 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:15:46</nova:creationTime>
Nov 29 23:15:46 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:15:46 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:15:46 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:15:46 user nova-compute[75244]:       <nova:owner>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:user uuid="6eb557daf278418793e7bb56882445f5">tempest-ServerStableDeviceRescueTest-564661104-project-member</nova:user>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:project uuid="96cbbfa8e5fa4f18b3bcd03868aaab29">tempest-ServerStableDeviceRescueTest-564661104</nova:project>
Nov 29 23:15:46 user nova-compute[75244]:       </nova:owner>
Nov 29 23:15:46 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:15:46 user nova-compute[75244]:       <nova:ports>
Nov 29 23:15:46 user nova-compute[75244]:         <nova:port uuid="45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac">
Nov 29 23:15:46 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:15:46 user nova-compute[75244]:         </nova:port>
Nov 29 23:15:46 user nova-compute[75244]:       </nova:ports>
Nov 29 23:15:46 user nova-compute[75244]:     </nova:instance>
Nov 29 23:15:46 user nova-compute[75244]:   </metadata>
Nov 29 23:15:46 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:15:46 user nova-compute[75244]:     <system>
Nov 29 23:15:46 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:15:46 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:15:46 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:15:46 user nova-compute[75244]:       <entry name="serial">34b60257-6546-447b-8b6d-f95eb0fdab74</entry>
Nov 29 23:15:46 user nova-compute[75244]:       <entry name="uuid">34b60257-6546-447b-8b6d-f95eb0fdab74</entry>
Nov 29 23:15:46 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:15:46 user nova-compute[75244]:     </system>
Nov 29 23:15:46 user nova-compute[75244]:   </sysinfo>
Nov 29 23:15:46 user nova-compute[75244]:   <os>
Nov 29 23:15:46 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:15:46 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:15:46 user nova-compute[75244]:   </os>
Nov 29 23:15:46 user nova-compute[75244]:   <features>
Nov 29 23:15:46 user nova-compute[75244]:     <acpi/>
Nov 29 23:15:46 user nova-compute[75244]:     <apic/>
Nov 29 23:15:46 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:15:46 user nova-compute[75244]:   </features>
Nov 29 23:15:46 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:15:46 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:15:46 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:15:46 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:15:46 user nova-compute[75244]:   </clock>
Nov 29 23:15:46 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:15:46 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:15:46 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:15:46 user nova-compute[75244]:   </cpu>
Nov 29 23:15:46 user nova-compute[75244]:   <devices>
Nov 29 23:15:46 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:15:46 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:15:46 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk"/>
Nov 29 23:15:46 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:15:46 user nova-compute[75244]:     </disk>
Nov 29 23:15:46 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:15:46 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:15:46 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:15:46 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:15:46 user nova-compute[75244]:       <serial>d3f9d21d-8d4b-45af-8e1a-34af33996800</serial>
Nov 29 23:15:46 user nova-compute[75244]:     </disk>
Nov 29 23:15:46 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:15:46 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:15:46 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue"/>
Nov 29 23:15:46 user nova-compute[75244]:       <target dev="vdc" bus="virtio"/>
Nov 29 23:15:46 user nova-compute[75244]:       <boot order="1"/>
Nov 29 23:15:46 user nova-compute[75244]:     </disk>
Nov 29 23:15:46 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:15:46 user nova-compute[75244]:       <mac address="fa:16:3e:81:f3:0c"/>
Nov 29 23:15:46 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:46 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:15:46 user nova-compute[75244]:       <target dev="tap45e66a9e-17"/>
Nov 29 23:15:46 user nova-compute[75244]:     </interface>
Nov 29 23:15:46 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:15:46 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/console.log" append="off"/>
Nov 29 23:15:46 user nova-compute[75244]:     </serial>
Nov 29 23:15:46 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:15:46 user nova-compute[75244]:     <video>
Nov 29 23:15:46 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:15:46 user nova-compute[75244]:     </video>
Nov 29 23:15:46 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:15:46 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:15:46 user nova-compute[75244]:     </rng>
Nov 29 23:15:46 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:15:46 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:15:46 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:15:46 user nova-compute[75244]:     </memballoon>
Nov 29 23:15:46 user nova-compute[75244]:   </devices>
Nov 29 23:15:46 user nova-compute[75244]: </domain>
Nov 29 23:15:46 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance destroyed successfully.
Nov 29 23:15:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] No VIF found with MAC fa:16:3e:81:f3:0c, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:15:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'flavor' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-7c79fed0-7659-4623-b3f7-595adc9e917d tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-86fde66d-348b-474e-8a36-8007b4647add req-26c3124d-fcb2-48ab-8213-1a3ed27dbd47 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86fde66d-348b-474e-8a36-8007b4647add req-26c3124d-fcb2-48ab-8213-1a3ed27dbd47 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86fde66d-348b-474e-8a36-8007b4647add req-26c3124d-fcb2-48ab-8213-1a3ed27dbd47 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86fde66d-348b-474e-8a36-8007b4647add req-26c3124d-fcb2-48ab-8213-1a3ed27dbd47 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-86fde66d-348b-474e-8a36-8007b4647add req-26c3124d-fcb2-48ab-8213-1a3ed27dbd47 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:51 user nova-compute[75244]: WARNING nova.compute.manager [req-86fde66d-348b-474e-8a36-8007b4647add req-26c3124d-fcb2-48ab-8213-1a3ed27dbd47 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state active and task_state rescuing.
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-f542c987-f40b-4508-9860-1b6d7a486fc7 req-1e31a3db-3f3f-49f4-8c82-1554269a941d service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f542c987-f40b-4508-9860-1b6d7a486fc7 req-1e31a3db-3f3f-49f4-8c82-1554269a941d service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f542c987-f40b-4508-9860-1b6d7a486fc7 req-1e31a3db-3f3f-49f4-8c82-1554269a941d service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f542c987-f40b-4508-9860-1b6d7a486fc7 req-1e31a3db-3f3f-49f4-8c82-1554269a941d service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-f542c987-f40b-4508-9860-1b6d7a486fc7 req-1e31a3db-3f3f-49f4-8c82-1554269a941d service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:15:51 user nova-compute[75244]: WARNING nova.compute.manager [req-f542c987-f40b-4508-9860-1b6d7a486fc7 req-1e31a3db-3f3f-49f4-8c82-1554269a941d service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state active and task_state rescuing.
Nov 29 23:15:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:15:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=25.025978088378906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:15:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5e2b807-0102-492f-9388-849054f02a7e tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.521s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:15:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:15:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:15:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:16:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:16:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:16:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:16:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:16:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:16:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:16:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:16:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:16:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:16:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:16:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:41 user nova-compute[75244]: INFO nova.compute.manager [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Terminating instance
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-9016a07e-e892-4b97-9f10-8cde80b4e8fa req-fe4dd84d-98e8-4423-ba73-4bb56cfa37f2 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-unplugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9016a07e-e892-4b97-9f10-8cde80b4e8fa req-fe4dd84d-98e8-4423-ba73-4bb56cfa37f2 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9016a07e-e892-4b97-9f10-8cde80b4e8fa req-fe4dd84d-98e8-4423-ba73-4bb56cfa37f2 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9016a07e-e892-4b97-9f10-8cde80b4e8fa req-fe4dd84d-98e8-4423-ba73-4bb56cfa37f2 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-9016a07e-e892-4b97-9f10-8cde80b4e8fa req-fe4dd84d-98e8-4423-ba73-4bb56cfa37f2 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-unplugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-9016a07e-e892-4b97-9f10-8cde80b4e8fa req-fe4dd84d-98e8-4423-ba73-4bb56cfa37f2 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-unplugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Instance destroyed successfully.
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lazy-loading 'resources' on Instance uuid cbf0aa1a-70a3-44c0-a6c4-0276ea375300 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1479901573',display_name='tempest-AttachVolumeTestJSON-server-1479901573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1479901573',id=28,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXVPqC4xPF7JZN+AX6oImGP1QsXVEzezW00Njs+2VkHC+CJfVBQG5v4wdN8lJcWKwYV+diNkoLUNipIwtHusmEtIIfDXe1JOOrV8Fgp+wqh5o7lJwkXBzbMicJ5vA01w==',key_name='tempest-keypair-438936613',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b3fc795bdd143a9bbb8b3d5a040e92f',ramdisk_id='',reservation_id='r-eobiqqpf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2123642001',owner_user_name='tempest-AttachVolumeTestJSON-2123642001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab2f432fdbf48d3bc546158221a1448',uuid=cbf0aa1a-70a3-44c0-a6c4-0276ea375300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converting VIF {"id": "0e8c8d42-4990-43a5-9060-d4625842f795", "address": "fa:16:3e:38:e3:92", "network": {"id": "2be3a5fa-32ac-4282-8693-97d1bb3e1c1e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-614636547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3fc795bdd143a9bbb8b3d5a040e92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8c8d42-49", "ovs_interfaceid": "0e8c8d42-4990-43a5-9060-d4625842f795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG os_vif [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e8c8d42-49, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1430433e-5ee0-426b-9592-567c9358bf48) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: INFO os_vif [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e3:92,bridge_name='br-int',has_traffic_filtering=True,id=0e8c8d42-4990-43a5-9060-d4625842f795,network=Network(2be3a5fa-32ac-4282-8693-97d1bb3e1c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8c8d42-49')
Nov 29 23:16:41 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Deleting instance files /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300_del
Nov 29 23:16:41 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Deletion of /opt/stack/data/nova/instances/cbf0aa1a-70a3-44c0-a6c4-0276ea375300_del complete
Nov 29 23:16:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:41 user nova-compute[75244]: INFO nova.compute.manager [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 23:16:41 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:16:41 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:43 user nova-compute[75244]: WARNING nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received unexpected event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with vm_state active and task_state deleting.
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:43 user nova-compute[75244]: WARNING nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received unexpected event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with vm_state active and task_state deleting.
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:43 user nova-compute[75244]: WARNING nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received unexpected event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with vm_state active and task_state deleting.
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-unplugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-unplugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-unplugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Acquiring lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] No waiting events found dispatching network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:43 user nova-compute[75244]: WARNING nova.compute.manager [req-606ac018-b313-49eb-96f8-af706a01bfb3 req-bf7b9d6a-7a1d-49d9-8662-b842737cc6e7 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received unexpected event network-vif-plugged-0e8c8d42-4990-43a5-9060-d4625842f795 for instance with vm_state active and task_state deleting.
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:16:43 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Took 1.91 seconds to deallocate network for instance.
Nov 29 23:16:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-a3ebb803-2e46-4e70-8546-c9ae8662ced7 req-217fcb4a-f4a9-494b-a354-a5a1d90e3ed6 service nova] [instance: cbf0aa1a-70a3-44c0-a6c4-0276ea375300] Received event network-vif-deleted-0e8c8d42-4990-43a5-9060-d4625842f795 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:16:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:16:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:44 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Deleted allocations for instance cbf0aa1a-70a3-44c0-a6c4-0276ea375300
Nov 29 23:16:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a31cba8b-6fbd-4ee8-b59e-bdbf43656f8f tempest-AttachVolumeTestJSON-2123642001 tempest-AttachVolumeTestJSON-2123642001-project-member] Lock "cbf0aa1a-70a3-44c0-a6c4-0276ea375300" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.390s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:44 user nova-compute[75244]: DEBUG nova.objects.instance [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'flavor' on Instance uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:45 user nova-compute[75244]: INFO nova.compute.manager [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attaching volume 4e91b542-bf31-4de8-9f9e-81e46267182f to /dev/vdb
Nov 29 23:16:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e0cb07-2d5c-400b-820e-998923463f7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9db7cd-1433-4fb6-8d24-41b288952ae7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c049ad0-de4e-494a-8306-8692db7b8dc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f342ba28-0c8d-4b3e-921b-9e38efc93504]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:16:45 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f2177-eba9-446f-90db-89b43b93266e]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updating existing volume attachment record: 4114db7f-d6ae-412f-983a-a570ecfd5ad8 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-changed-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Refreshing instance network info cache due to event network-changed-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] Acquiring lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] Acquired lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG nova.network.neutron [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Refreshing network info cache for port 796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:16:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updated VIF entry in instance network info cache for port 796f511a-90e8-4b6f-8bc0-25ed0d7fff0f. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updating instance_info_cache with network_info: [{"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ca2188a9-73f4-4072-84fc-0ffe5da4dbf8 req-b97fdb27-ed74-49fa-a591-b75c0e86b961 service nova] Releasing lock "refresh_cache-1bac525e-daeb-49d9-a4bc-96bf5bd2543d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:16:48 user nova-compute[75244]: INFO nova.compute.claims [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Claim successful on node user
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:16:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=24.91458511352539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.877s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.148s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:16:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.policy [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52463fb99804a39a7400dd0a62bc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8586834ec2a40eea6c8ee777319d909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:16:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Creating image(s)
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "/opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "/opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "/opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk 1073741824" returned: 0 in 0.059s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Successfully created port: 99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.210s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Cannot resize image /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Ensure instance console log exists: /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:16:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Successfully updated port: 99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquired lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-changed-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Refreshing instance network info cache due to event network-changed-99a1270e-6789-4836-b124-3bf904239ba2. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] Acquiring lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating instance_info_cache with network_info: [{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Releasing lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Instance network_info: |[{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] Acquired lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Refreshing network info cache for port 99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Start _get_guest_xml network_info=[{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:16:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:16:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-30234130',display_name='tempest-TestStampPattern-server-30234130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-30234130',id=32,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxte1rpyd5jQaGmUdfHPyQkG0c+iZHTywDrmc5m23eGK8tv2O5fUwNn4LhRvmXk79qHy4OuFi7LT7wqD0Kzwx6FDf7BPhKuTYVdjZFWcl01pmaKjbzmxpXWb8uFBV71Gw==',key_name='tempest-TestStampPattern-1844974625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8586834ec2a40eea6c8ee777319d909',ramdisk_id='',reservation_id='r-j7ay331b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1117540779',owner_user_name='tempest-TestStampPattern-1117540779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:16:49Z,user_data=None,user_id='d52463fb99804a39a7400dd0a62bc7a0',uuid=7077e5ec-3f09-45f9-a011-d89eaf58d888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converting VIF {"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'pci_devices' on Instance uuid 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:16:51 user nova-compute[75244]:   <uuid>7077e5ec-3f09-45f9-a011-d89eaf58d888</uuid>
Nov 29 23:16:51 user nova-compute[75244]:   <name>instance-00000020</name>
Nov 29 23:16:51 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:16:51 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:16:51 user nova-compute[75244]:   <metadata>
Nov 29 23:16:51 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:16:51 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:16:51 user nova-compute[75244]:       <nova:name>tempest-TestStampPattern-server-30234130</nova:name>
Nov 29 23:16:51 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:16:51</nova:creationTime>
Nov 29 23:16:51 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:16:51 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:16:51 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:16:51 user nova-compute[75244]:       <nova:owner>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:user uuid="d52463fb99804a39a7400dd0a62bc7a0">tempest-TestStampPattern-1117540779-project-member</nova:user>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:project uuid="c8586834ec2a40eea6c8ee777319d909">tempest-TestStampPattern-1117540779</nova:project>
Nov 29 23:16:51 user nova-compute[75244]:       </nova:owner>
Nov 29 23:16:51 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:16:51 user nova-compute[75244]:       <nova:ports>
Nov 29 23:16:51 user nova-compute[75244]:         <nova:port uuid="99a1270e-6789-4836-b124-3bf904239ba2">
Nov 29 23:16:51 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 23:16:51 user nova-compute[75244]:         </nova:port>
Nov 29 23:16:51 user nova-compute[75244]:       </nova:ports>
Nov 29 23:16:51 user nova-compute[75244]:     </nova:instance>
Nov 29 23:16:51 user nova-compute[75244]:   </metadata>
Nov 29 23:16:51 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:16:51 user nova-compute[75244]:     <system>
Nov 29 23:16:51 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:16:51 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:16:51 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:16:51 user nova-compute[75244]:       <entry name="serial">7077e5ec-3f09-45f9-a011-d89eaf58d888</entry>
Nov 29 23:16:51 user nova-compute[75244]:       <entry name="uuid">7077e5ec-3f09-45f9-a011-d89eaf58d888</entry>
Nov 29 23:16:51 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:16:51 user nova-compute[75244]:     </system>
Nov 29 23:16:51 user nova-compute[75244]:   </sysinfo>
Nov 29 23:16:51 user nova-compute[75244]:   <os>
Nov 29 23:16:51 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:16:51 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:16:51 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:16:51 user nova-compute[75244]:   </os>
Nov 29 23:16:51 user nova-compute[75244]:   <features>
Nov 29 23:16:51 user nova-compute[75244]:     <acpi/>
Nov 29 23:16:51 user nova-compute[75244]:     <apic/>
Nov 29 23:16:51 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:16:51 user nova-compute[75244]:   </features>
Nov 29 23:16:51 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:16:51 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:16:51 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:16:51 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:16:51 user nova-compute[75244]:   </clock>
Nov 29 23:16:51 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:16:51 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:16:51 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:16:51 user nova-compute[75244]:   </cpu>
Nov 29 23:16:51 user nova-compute[75244]:   <devices>
Nov 29 23:16:51 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:16:51 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:16:51 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk"/>
Nov 29 23:16:51 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:16:51 user nova-compute[75244]:     </disk>
Nov 29 23:16:51 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:16:51 user nova-compute[75244]:       <mac address="fa:16:3e:35:52:ea"/>
Nov 29 23:16:51 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:16:51 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:16:51 user nova-compute[75244]:       <target dev="tap99a1270e-67"/>
Nov 29 23:16:51 user nova-compute[75244]:     </interface>
Nov 29 23:16:51 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:16:51 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/console.log" append="off"/>
Nov 29 23:16:51 user nova-compute[75244]:     </serial>
Nov 29 23:16:51 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:16:51 user nova-compute[75244]:     <video>
Nov 29 23:16:51 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:16:51 user nova-compute[75244]:     </video>
Nov 29 23:16:51 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:16:51 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:16:51 user nova-compute[75244]:     </rng>
Nov 29 23:16:51 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:16:51 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:16:51 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:16:51 user nova-compute[75244]:     </memballoon>
Nov 29 23:16:51 user nova-compute[75244]:   </devices>
Nov 29 23:16:51 user nova-compute[75244]: </domain>
Nov 29 23:16:51 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-30234130',display_name='tempest-TestStampPattern-server-30234130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-30234130',id=32,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxte1rpyd5jQaGmUdfHPyQkG0c+iZHTywDrmc5m23eGK8tv2O5fUwNn4LhRvmXk79qHy4OuFi7LT7wqD0Kzwx6FDf7BPhKuTYVdjZFWcl01pmaKjbzmxpXWb8uFBV71Gw==',key_name='tempest-TestStampPattern-1844974625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8586834ec2a40eea6c8ee777319d909',ramdisk_id='',reservation_id='r-j7ay331b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1117540779',owner_user_name='tempest-TestStampPattern-1117540779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:16:49Z,user_data=None,user_id='d52463fb99804a39a7400dd0a62bc7a0',uuid=7077e5ec-3f09-45f9-a011-d89eaf58d888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converting VIF {"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG os_vif [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb1bac70-6a73-5c6c-b343-298e76882e71', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99a1270e-67, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99a1270e-67, col_values=(('qos', UUID('2c9e9932-a765-48f2-8a85-3ef5c718c968')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99a1270e-67, col_values=(('external_ids', {'iface-id': '99a1270e-6789-4836-b124-3bf904239ba2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:52:ea', 'vm-uuid': '7077e5ec-3f09-45f9-a011-d89eaf58d888'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:51 user nova-compute[75244]: INFO os_vif [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67')
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No VIF found with MAC fa:16:3e:35:52:ea, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updated VIF entry in instance network info cache for port 99a1270e-6789-4836-b124-3bf904239ba2. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating instance_info_cache with network_info: [{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:16:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5241bafb-e29d-49d4-a4bf-c232c65d40a6 req-f52c48d5-9825-4144-8c07-83e7d924ff42 service nova] Releasing lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:16:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-b2a68a25-29ac-4d9d-8b8d-15109abfd3d4 req-21f5aee1-d001-4d70-b88e-4638da31fa81 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b2a68a25-29ac-4d9d-8b8d-15109abfd3d4 req-21f5aee1-d001-4d70-b88e-4638da31fa81 service nova] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b2a68a25-29ac-4d9d-8b8d-15109abfd3d4 req-21f5aee1-d001-4d70-b88e-4638da31fa81 service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b2a68a25-29ac-4d9d-8b8d-15109abfd3d4 req-21f5aee1-d001-4d70-b88e-4638da31fa81 service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-b2a68a25-29ac-4d9d-8b8d-15109abfd3d4 req-21f5aee1-d001-4d70-b88e-4638da31fa81 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] No waiting events found dispatching network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:53 user nova-compute[75244]: WARNING nova.compute.manager [req-b2a68a25-29ac-4d9d-8b8d-15109abfd3d4 req-21f5aee1-d001-4d70-b88e-4638da31fa81 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received unexpected event network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 for instance with vm_state building and task_state spawning.
Nov 29 23:16:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-338d87b2-7e04-417a-9d69-5f8c43282dcf req-802c723f-e6c0-407d-a6cd-e2e199666862 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-338d87b2-7e04-417a-9d69-5f8c43282dcf req-802c723f-e6c0-407d-a6cd-e2e199666862 service nova] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-338d87b2-7e04-417a-9d69-5f8c43282dcf req-802c723f-e6c0-407d-a6cd-e2e199666862 service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-338d87b2-7e04-417a-9d69-5f8c43282dcf req-802c723f-e6c0-407d-a6cd-e2e199666862 service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-338d87b2-7e04-417a-9d69-5f8c43282dcf req-802c723f-e6c0-407d-a6cd-e2e199666862 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] No waiting events found dispatching network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:16:55 user nova-compute[75244]: WARNING nova.compute.manager [req-338d87b2-7e04-417a-9d69-5f8c43282dcf req-802c723f-e6c0-407d-a6cd-e2e199666862 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received unexpected event network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 for instance with vm_state building and task_state spawning.
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:16:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Instance spawned successfully.
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:16:55 user nova-compute[75244]: INFO nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 29 23:16:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:16:55 user nova-compute[75244]: INFO nova.compute.manager [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Took 7.06 seconds to build instance.
Nov 29 23:16:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e42a7046-54ed-4efe-840a-25b6170c2671 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.167s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:16:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:16:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:16:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:16:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:16:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:16:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:16:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:16:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:16:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:16:56 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:16:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ec5f0-d967-4e59-ab66-3b25aade5f0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:16:57 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f61c6-f1a7-4c22-bfd4-ddc34eabb44c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f] added
Nov 29 23:16:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60755d-9a8d-4f72-a348-ffd4e1432647]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87238e3-c23c-4411-867a-58c445f3b6d8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTMKIZBF {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTMKIZBF" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45635ae8-4822-4010-916d-9d549877b6c0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DTMKIZBF'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece724e-be71-48da-b651-c92331965577]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6daf8-3fbe-4f50-99ba-e4066f463458]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:16:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:16:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1598b11-61be-4541-a534-38f73825f1f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]
Nov 29 23:16:57 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.
Nov 29 23:16:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9658998-e276-4f1d-8917-726a4780593a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aef527c-30b9-4453-8a60-69db0994577b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:16:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:16:57 user nova-compute[75244]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:16:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8ef30-2f5a-4714-9db4-aa9abfb7bb6e]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:16:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23531373666626336', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373666626336', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG nova.objects.instance [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'flavor' on Instance uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:16:58 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:16:58 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:16:58 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:16:58 user nova-compute[75244]:   <serial>4e91b542-bf31-4de8-9f9e-81e46267182f</serial>
Nov 29 23:16:58 user nova-compute[75244]: </disk>
Nov 29 23:16:58 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No VIF found with MAC fa:16:3e:99:6a:7d, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:16:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93953bb0-7670-41cf-ad71-e9dc5d284ba7 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.763s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:00 user nova-compute[75244]: INFO nova.compute.manager [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Rebuilding instance
Nov 29 23:17:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-73703612-2386-46c4-ab1f-abeeef0cd470 req-396d05e6-5f96-408f-83de-96bc126f3263 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-unplugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73703612-2386-46c4-ab1f-abeeef0cd470 req-396d05e6-5f96-408f-83de-96bc126f3263 service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73703612-2386-46c4-ab1f-abeeef0cd470 req-396d05e6-5f96-408f-83de-96bc126f3263 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-73703612-2386-46c4-ab1f-abeeef0cd470 req-396d05e6-5f96-408f-83de-96bc126f3263 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-73703612-2386-46c4-ab1f-abeeef0cd470 req-396d05e6-5f96-408f-83de-96bc126f3263 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-unplugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:00 user nova-compute[75244]: WARNING nova.compute.manager [req-73703612-2386-46c4-ab1f-abeeef0cd470 req-396d05e6-5f96-408f-83de-96bc126f3263 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-unplugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state active and task_state rebuilding.
Nov 29 23:17:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance destroyed successfully.
Nov 29 23:17:01 user nova-compute[75244]: INFO nova.compute.manager [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Detaching volume 4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:17:01 user nova-compute[75244]: INFO nova.virt.block_device [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attempting to driver detach volume 4e91b542-bf31-4de8-9f9e-81e46267182f from mountpoint /dev/vdb
Nov 29 23:17:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Attempting to detach device vdb from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:17:01 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:17:01 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:17:01 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:17:01 user nova-compute[75244]:   <serial>4e91b542-bf31-4de8-9f9e-81e46267182f</serial>
Nov 29 23:17:01 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:17:01 user nova-compute[75244]: </disk>
Nov 29 23:17:01 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:17:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully detached device vdb from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d from the persistent domain config.
Nov 29 23:17:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:01 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[70786984-4ae4-464c-be78-9ad5a0fe5b79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:17:01 user nova-compute[75244]: No targets found.
Nov 29 23:17:01 user nova-compute[75244]: iSNS:
Nov 29 23:17:01 user nova-compute[75244]: No targets found.
Nov 29 23:17:01 user nova-compute[75244]: STATIC:
Nov 29 23:17:01 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:17:01 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:01 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:01 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:17:01 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:01 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:01 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:17:01 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:01 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:01 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:17:01 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:01 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:01 user nova-compute[75244]: FIRMWARE:
Nov 29 23:17:01 user nova-compute[75244]: No targets found.
Nov 29 23:17:01 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:17:01 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:17:01 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6326c44a-76ec-46c6-b17d-62a8edfbc6a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a876f93e-185e-44e5-bbd7-70c39a0b5489]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:01 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:01 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:01 user nova-compute[75244]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:01 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:01 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:01 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:01 user nova-compute[75244]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:01 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c4748b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb474dbd-e1a5-48b8-9a84-edb8a97b3af5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23bcbb6-4c21-404e-9d8e-3dd4bc6c2a5d]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb262e48-4dd7-4d6a-bb32-102065219ed5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0223eb-8bba-4cf1-8cb7-5e23cd12d079]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad0db1-4526-45fd-bc4a-4da675d9dcaf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff6c3b-021f-4de1-9b70-80596a39257d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]
Nov 29 23:17:01 user nova-compute[75244]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.
Nov 29 23:17:01 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fef960-0d3e-4116-9784-5bbcb14feab9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== disconnect_volume: return (303ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:17:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance destroyed successfully.
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1643090801',display_name='tempest-ServerActionsTestOtherA-server-1723557111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1643090801',id=29,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErh/VToo0qYK6+7fEb47QasHwkBDh/Di7DcZqgW5G5XcHJcicmvkwPEc73bpsWhk53vBOdaarefC0jqkVt2PY7VV6Oq48EkCO2rbi5COodppn+fElofB2+D+fgtpAooDw==',key_name='tempest-keypair-1881256599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-6bytho4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1bac525e-daeb-49d9-a4bc-96bf5bd2543d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap796f511a-90, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e987717-7ed3-4678-93a7-58cdd7b914b0) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:02 user nova-compute[75244]: INFO os_vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90')
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:02 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec198e-f314-479b-84c4-74ee7bb5fd97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:17:02 user nova-compute[75244]: No targets found.
Nov 29 23:17:02 user nova-compute[75244]: iSNS:
Nov 29 23:17:02 user nova-compute[75244]: No targets found.
Nov 29 23:17:02 user nova-compute[75244]: STATIC:
Nov 29 23:17:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:17:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:17:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:17:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:02 user nova-compute[75244]: FIRMWARE:
Nov 29 23:17:02 user nova-compute[75244]: No targets found.
Nov 29 23:17:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:17:02 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:17:02 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3760168a-3845-467d-bd3c-4177e7e62944]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[05661c01-394a-4375-a166-f8af4f3d3408]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:02 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:02 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:02 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:02 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804746d40>, {}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Disconnecting from: [] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== disconnect_volume: return (71ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:17:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Deleting instance files /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d_del
Nov 29 23:17:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Deletion of /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d_del complete
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-bf186857-a4a3-4ec3-9f72-1d8a56429d2b req-1ff962da-6b5c-4b9f-94ea-37f93d522248 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bf186857-a4a3-4ec3-9f72-1d8a56429d2b req-1ff962da-6b5c-4b9f-94ea-37f93d522248 service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bf186857-a4a3-4ec3-9f72-1d8a56429d2b req-1ff962da-6b5c-4b9f-94ea-37f93d522248 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bf186857-a4a3-4ec3-9f72-1d8a56429d2b req-1ff962da-6b5c-4b9f-94ea-37f93d522248 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-bf186857-a4a3-4ec3-9f72-1d8a56429d2b req-1ff962da-6b5c-4b9f-94ea-37f93d522248 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:02 user nova-compute[75244]: WARNING nova.compute.manager [req-bf186857-a4a3-4ec3-9f72-1d8a56429d2b req-1ff962da-6b5c-4b9f-94ea-37f93d522248 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state active and task_state rebuilding.
Nov 29 23:17:02 user nova-compute[75244]: INFO nova.virt.block_device [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Booting with volume 4e91b542-bf31-4de8-9f9e-81e46267182f at /dev/vdb
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.utils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfc58bd-ea41-4bd3-90dc-9ed5122520dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7bb142-c633-426e-89d7-2073e1369ed8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae15ddd4-7019-485a-a3aa-1c7ff9c081b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65044d1-99d1-43c4-8a56-b6b8e56bd8da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:17:02 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:17:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac533e84-97f1-485e-8233-81a54534a3cb]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG os_brick.utils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:02 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updating existing volume attachment record: 76ae9893-8e4d-411a-b729-e1d75e999663 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:17:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-changed-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Refreshing instance network info cache due to event network-changed-4d6d1a11-8d34-413f-ae0f-b304f2812e38. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] Acquiring lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] Acquired lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Refreshing network info cache for port 4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updated VIF entry in instance network info cache for port 4d6d1a11-8d34-413f-ae0f-b304f2812e38. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG nova.network.neutron [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updating instance_info_cache with network_info: [{"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-10fa1962-3a58-455d-a0ea-17b7e838e415 req-b739fb70-01ee-448a-bd4f-ea330dbee3a0 service nova] Releasing lock "refresh_cache-7acb45a6-a508-423e-9b1f-b93a29ab5da9" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:17:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:17:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Creating image(s)
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk 1073741824" returned: 0 in 0.051s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Cannot resize image /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Ensure instance console log exists: /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Start _get_guest_xml network_info=[{"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bac525e-daeb-49d9-a4bc-96bf5bd2543d', 'attached_at': '', 'detached_at': '', 'volume_id': '4e91b542-bf31-4de8-9f9e-81e46267182f', 'serial': '4e91b542-bf31-4de8-9f9e-81e46267182f'}, 'attachment_id': '76ae9893-8e4d-411a-b729-e1d75e999663', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:17:11 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 23:17:11 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:17:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:12 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[843f402a-7c59-453a-bdac-065e269ccb8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:17:12 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77c541-a8b6-473d-af03-06d650d68516]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f] added
Nov 29 23:17:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be6c1bf-671b-4ab8-b5fa-65860e476b75]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd025c-8af0-4e45-8382-5a650de6e846]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTMKIZBF {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTMKIZBF" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ea4af-da17-4c32-ad29-a9ebce51de3f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DTMKIZBF'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be51776-b515-40e6-bd52-667db4b0a44d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b7ab68-1a13-47fb-a8a2-0a24e522086b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b7ef2f-c76b-46b1-88ea-beed56d65098]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]
Nov 29 23:17:12 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.
Nov 29 23:17:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4d82a-0cd2-4970-a27c-048291d1c52e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156e5fd-8a7f-4db8-b273-f42aab2fda9d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:12 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29b991-9b25-46e5-8898-941287438e91]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:12 user nova-compute[75244]: INFO nova.compute.manager [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Attaching volume d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 to /dev/vdb
Nov 29 23:17:12 user nova-compute[75244]: DEBUG os_brick.utils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa8dc7-f162-4a4e-a9f4-15a20586bdc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010cdea-a9de-4b6e-a243-3df0ad979404]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829d789-8b46-4fbd-acdb-b2f4612faa71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9618b5-0e1c-488e-8892-57cee53f6dd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:17:13 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:17:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5235984e-114a-4dea-a3b8-cd26b8efd2e1]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.utils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updating existing volume attachment record: f178992b-3206-49b8-aa4d-72d4b2b4696a {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23531373666626336', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373666626336', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1643090801',display_name='tempest-ServerActionsTestOtherA-server-1723557111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1643090801',id=29,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErh/VToo0qYK6+7fEb47QasHwkBDh/Di7DcZqgW5G5XcHJcicmvkwPEc73bpsWhk53vBOdaarefC0jqkVt2PY7VV6Oq48EkCO2rbi5COodppn+fElofB2+D+fgtpAooDw==',key_name='tempest-keypair-1881256599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-6bytho4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1bac525e-daeb-49d9-a4bc-96bf5bd2543d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:17:13 user nova-compute[75244]:   <uuid>1bac525e-daeb-49d9-a4bc-96bf5bd2543d</uuid>
Nov 29 23:17:13 user nova-compute[75244]:   <name>instance-0000001d</name>
Nov 29 23:17:13 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:17:13 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:17:13 user nova-compute[75244]:   <metadata>
Nov 29 23:17:13 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:17:13 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:17:13 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherA-server-1723557111</nova:name>
Nov 29 23:17:13 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:17:11</nova:creationTime>
Nov 29 23:17:13 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:17:13 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:17:13 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:17:13 user nova-compute[75244]:       <nova:owner>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:user uuid="c6d9dd0466344edc8b9aad74fd1fe1b0">tempest-ServerActionsTestOtherA-1557642123-project-member</nova:user>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:project uuid="6f36d441ef074e09bcb59e29b03b5e77">tempest-ServerActionsTestOtherA-1557642123</nova:project>
Nov 29 23:17:13 user nova-compute[75244]:       </nova:owner>
Nov 29 23:17:13 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:17:13 user nova-compute[75244]:       <nova:ports>
Nov 29 23:17:13 user nova-compute[75244]:         <nova:port uuid="796f511a-90e8-4b6f-8bc0-25ed0d7fff0f">
Nov 29 23:17:13 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:17:13 user nova-compute[75244]:         </nova:port>
Nov 29 23:17:13 user nova-compute[75244]:       </nova:ports>
Nov 29 23:17:13 user nova-compute[75244]:     </nova:instance>
Nov 29 23:17:13 user nova-compute[75244]:   </metadata>
Nov 29 23:17:13 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:17:13 user nova-compute[75244]:     <system>
Nov 29 23:17:13 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:17:13 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:17:13 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:17:13 user nova-compute[75244]:       <entry name="serial">1bac525e-daeb-49d9-a4bc-96bf5bd2543d</entry>
Nov 29 23:17:13 user nova-compute[75244]:       <entry name="uuid">1bac525e-daeb-49d9-a4bc-96bf5bd2543d</entry>
Nov 29 23:17:13 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:17:13 user nova-compute[75244]:     </system>
Nov 29 23:17:13 user nova-compute[75244]:   </sysinfo>
Nov 29 23:17:13 user nova-compute[75244]:   <os>
Nov 29 23:17:13 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:17:13 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:17:13 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:17:13 user nova-compute[75244]:   </os>
Nov 29 23:17:13 user nova-compute[75244]:   <features>
Nov 29 23:17:13 user nova-compute[75244]:     <acpi/>
Nov 29 23:17:13 user nova-compute[75244]:     <apic/>
Nov 29 23:17:13 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:17:13 user nova-compute[75244]:   </features>
Nov 29 23:17:13 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:17:13 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:17:13 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:17:13 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:17:13 user nova-compute[75244]:   </clock>
Nov 29 23:17:13 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:17:13 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:17:13 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:17:13 user nova-compute[75244]:   </cpu>
Nov 29 23:17:13 user nova-compute[75244]:   <devices>
Nov 29 23:17:13 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:17:13 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:17:13 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk"/>
Nov 29 23:17:13 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:17:13 user nova-compute[75244]:     </disk>
Nov 29 23:17:13 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:17:13 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:17:13 user nova-compute[75244]:       <source dev="/dev/sdd"/>
Nov 29 23:17:13 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:17:13 user nova-compute[75244]:       <serial>4e91b542-bf31-4de8-9f9e-81e46267182f</serial>
Nov 29 23:17:13 user nova-compute[75244]:     </disk>
Nov 29 23:17:13 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:17:13 user nova-compute[75244]:       <mac address="fa:16:3e:99:6a:7d"/>
Nov 29 23:17:13 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:17:13 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:17:13 user nova-compute[75244]:       <target dev="tap796f511a-90"/>
Nov 29 23:17:13 user nova-compute[75244]:     </interface>
Nov 29 23:17:13 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:17:13 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/console.log" append="off"/>
Nov 29 23:17:13 user nova-compute[75244]:     </serial>
Nov 29 23:17:13 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:17:13 user nova-compute[75244]:     <video>
Nov 29 23:17:13 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:17:13 user nova-compute[75244]:     </video>
Nov 29 23:17:13 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:17:13 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:17:13 user nova-compute[75244]:     </rng>
Nov 29 23:17:13 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:17:13 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:17:13 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:17:13 user nova-compute[75244]:     </memballoon>
Nov 29 23:17:13 user nova-compute[75244]:   </devices>
Nov 29 23:17:13 user nova-compute[75244]: </domain>
Nov 29 23:17:13 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1643090801',display_name='tempest-ServerActionsTestOtherA-server-1723557111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1643090801',id=29,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErh/VToo0qYK6+7fEb47QasHwkBDh/Di7DcZqgW5G5XcHJcicmvkwPEc73bpsWhk53vBOdaarefC0jqkVt2PY7VV6Oq48EkCO2rbi5COodppn+fElofB2+D+fgtpAooDw==',key_name='tempest-keypair-1881256599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-6bytho4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1bac525e-daeb-49d9-a4bc-96bf5bd2543d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG os_vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6478c6-e70a-5bbf-bd1c-ddee0da084ed', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap796f511a-90, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap796f511a-90, col_values=(('qos', UUID('d8de29f7-a78b-4588-9220-b01043dfeb39')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap796f511a-90, col_values=(('external_ids', {'iface-id': '796f511a-90e8-4b6f-8bc0-25ed0d7fff0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:6a:7d', 'vm-uuid': '1bac525e-daeb-49d9-a4bc-96bf5bd2543d'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:13 user nova-compute[75244]: INFO os_vif [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90')
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:17:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No VIF found with MAC fa:16:3e:99:6a:7d, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-cb5346c4-d770-4169-b473-5716bb789e08 req-2946c7a0-5fb6-4932-9ac4-2007178d47e8 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cb5346c4-d770-4169-b473-5716bb789e08 req-2946c7a0-5fb6-4932-9ac4-2007178d47e8 service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cb5346c4-d770-4169-b473-5716bb789e08 req-2946c7a0-5fb6-4932-9ac4-2007178d47e8 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cb5346c4-d770-4169-b473-5716bb789e08 req-2946c7a0-5fb6-4932-9ac4-2007178d47e8 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-cb5346c4-d770-4169-b473-5716bb789e08 req-2946c7a0-5fb6-4932-9ac4-2007178d47e8 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:14 user nova-compute[75244]: WARNING nova.compute.manager [req-cb5346c4-d770-4169-b473-5716bb789e08 req-2946c7a0-5fb6-4932-9ac4-2007178d47e8 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state active and task_state rebuild_spawning.
Nov 29 23:17:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:17:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance spawned successfully.
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:17:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-c2fc8e23-b223-4b21-ac4b-ada4e7d25fc1 req-2132f871-8627-4c0b-be4f-395fc83aa15b service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c2fc8e23-b223-4b21-ac4b-ada4e7d25fc1 req-2132f871-8627-4c0b-be4f-395fc83aa15b service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c2fc8e23-b223-4b21-ac4b-ada4e7d25fc1 req-2132f871-8627-4c0b-be4f-395fc83aa15b service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c2fc8e23-b223-4b21-ac4b-ada4e7d25fc1 req-2132f871-8627-4c0b-be4f-395fc83aa15b service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-c2fc8e23-b223-4b21-ac4b-ada4e7d25fc1 req-2132f871-8627-4c0b-be4f-395fc83aa15b service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:17 user nova-compute[75244]: WARNING nova.compute.manager [req-c2fc8e23-b223-4b21-ac4b-ada4e7d25fc1 req-2132f871-8627-4c0b-be4f-395fc83aa15b service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state active and task_state rebuild_spawning.
Nov 29 23:17:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75244) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 23:17:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5e261ed4-4392-48ba-845b-6ea748c8e644 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.094s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:17:21 user nova-compute[75244]: INFO nova.compute.manager [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] instance snapshotting
Nov 29 23:17:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Beginning live snapshot process
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnpPSNaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:21 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:21 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:21 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[241526b0-6390-4649-b501-e5a66e8597d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:17:21 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6314fd-2937-423c-8ad4-172c66fef41e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4] added
Nov 29 23:17:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea349e0d-b551-44b7-b0d2-87450c203f1e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2848476-f5b5-4866-b3e4-7facdc5771b7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnpPSNaV {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnpPSNaV" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[38905881-f431-44c1-8c16-8ece14bd7a65]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnpPSNaV'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc384be-a8d7-4f7a-9581-f69d85cd7d6f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf9c371-77a2-42d7-ae29-159ef2dd07c7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8b1972-e15f-46b7-b3be-65d4f945470a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8b1972-e15f-46b7-b3be-65d4f945470a (non-flash)
Nov 29 23:17:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8b1972-e15f-46b7-b3be-65d4f945470a (non-flash)
Nov 29 23:17:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08ffa8d-117b-4515-b21a-1969e8d3fbdd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260]
Nov 29 23:17:21 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260] successful.
Nov 29 23:17:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5121fac-d57f-4997-9211-187856546b5a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c35733-e523-4e40-b58b-8280d5a65203]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8b1972-e15f-46b7-b3be-65d4f945470a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8b1972-e15f-46b7-b3be-65d4f945470a (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 (non-flash)
Nov 29 23:17:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8b1972-e15f-46b7-b3be-65d4f945470a (non-flash)
Nov 29 23:17:21 user nova-compute[75244]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 (non-flash)
Nov 29 23:17:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a3563-cba3-42cb-8105-253b1cad31c8]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg_3c95t7/4b951c71e64c4d8d8663a1154e2663f6.delta 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg_3c95t7/4b951c71e64c4d8d8663a1154e2663f6.delta 1073741824" returned: 0 in 0.054s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:22 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 23:17:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnpPSNaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23465666661633832', 'path': '/dev/sdg'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465666661633832', 'path': '/dev/sdg'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:17:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:17:23 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:17:23 user nova-compute[75244]:   <source dev="/dev/sdg"/>
Nov 29 23:17:23 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:17:23 user nova-compute[75244]:   <serial>d0a5a6b8-89de-4054-b689-dbb09ce9dcd4</serial>
Nov 29 23:17:23 user nova-compute[75244]: </disk>
Nov 29 23:17:23 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:17:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 23:17:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg_3c95t7/4b951c71e64c4d8d8663a1154e2663f6.delta /opt/stack/data/nova/instances/snapshots/tmpg_3c95t7/4b951c71e64c4d8d8663a1154e2663f6 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] No VIF found with MAC fa:16:3e:2f:ef:7a, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-7692632f-f57b-49aa-8530-36e47679b8cc tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.859s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg_3c95t7/4b951c71e64c4d8d8663a1154e2663f6.delta /opt/stack/data/nova/instances/snapshots/tmpg_3c95t7/4b951c71e64c4d8d8663a1154e2663f6" returned: 0 in 0.534s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Snapshot extracted, beginning image upload
Nov 29 23:17:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:25 user nova-compute[75244]: INFO nova.compute.manager [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Detaching volume d0a5a6b8-89de-4054-b689-dbb09ce9dcd4
Nov 29 23:17:25 user nova-compute[75244]: INFO nova.virt.block_device [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Attempting to driver detach volume d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 from mountpoint /dev/vdb
Nov 29 23:17:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Attempting to detach device vdb from instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:17:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:17:25 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:17:25 user nova-compute[75244]:   <source dev="/dev/sdg"/>
Nov 29 23:17:25 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:17:25 user nova-compute[75244]:   <serial>d0a5a6b8-89de-4054-b689-dbb09ce9dcd4</serial>
Nov 29 23:17:25 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:17:25 user nova-compute[75244]: </disk>
Nov 29 23:17:25 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:17:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully detached device vdb from instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 from the persistent domain config.
Nov 29 23:17:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:17:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:17:25 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:17:25 user nova-compute[75244]:   <source dev="/dev/sdg"/>
Nov 29 23:17:25 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:17:25 user nova-compute[75244]:   <serial>d0a5a6b8-89de-4054-b689-dbb09ce9dcd4</serial>
Nov 29 23:17:25 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:17:25 user nova-compute[75244]: </disk>
Nov 29 23:17:25 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:17:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:17:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Snapshot image upload complete
Nov 29 23:17:26 user nova-compute[75244]: INFO nova.compute.manager [None req-a43af5ad-11bc-4fdc-85b1-6b6a93ab0ec6 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Took 5.32 seconds to snapshot the instance on the hypervisor.
Nov 29 23:17:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:33 user nova-compute[75244]: INFO nova.compute.manager [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Unrescuing
Nov 29 23:17:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:17:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:17:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:17:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:33 user nova-compute[75244]: DEBUG nova.network.neutron [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG nova.objects.instance [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'flavor' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-2b90710d-6be5-4288-bf89-d98f6d3f634c req-cb1c3d55-b23a-4408-b011-51c2e96ad2f3 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b90710d-6be5-4288-bf89-d98f6d3f634c req-cb1c3d55-b23a-4408-b011-51c2e96ad2f3 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b90710d-6be5-4288-bf89-d98f6d3f634c req-cb1c3d55-b23a-4408-b011-51c2e96ad2f3 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b90710d-6be5-4288-bf89-d98f6d3f634c req-cb1c3d55-b23a-4408-b011-51c2e96ad2f3 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-2b90710d-6be5-4288-bf89-d98f6d3f634c req-cb1c3d55-b23a-4408-b011-51c2e96ad2f3 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:34 user nova-compute[75244]: WARNING nova.compute.manager [req-2b90710d-6be5-4288-bf89-d98f6d3f634c req-cb1c3d55-b23a-4408-b011-51c2e96ad2f3 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:17:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing instance network info cache due to event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:17:34 user nova-compute[75244]: DEBUG nova.network.neutron [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:17:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance destroyed successfully.
Nov 29 23:17:35 user nova-compute[75244]: DEBUG nova.network.neutron [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updated VIF entry in instance network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:17:35 user nova-compute[75244]: DEBUG nova.network.neutron [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:17:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc4dff43-80de-455b-8b5f-1cb4b1721019 req-c0fea55c-6a02-42b1-8714-238dbe886cd9 service nova] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:17:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing instance network info cache due to event network-changed-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Refreshing network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-8c1b8ae8-4db8-485d-9031-3a64e1318456 req-a7206de5-70c7-4807-8a6e-716a7feb3214 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8c1b8ae8-4db8-485d-9031-3a64e1318456 req-a7206de5-70c7-4807-8a6e-716a7feb3214 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8c1b8ae8-4db8-485d-9031-3a64e1318456 req-a7206de5-70c7-4807-8a6e-716a7feb3214 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8c1b8ae8-4db8-485d-9031-3a64e1318456 req-a7206de5-70c7-4807-8a6e-716a7feb3214 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-8c1b8ae8-4db8-485d-9031-3a64e1318456 req-a7206de5-70c7-4807-8a6e-716a7feb3214 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:37 user nova-compute[75244]: WARNING nova.compute.manager [req-8c1b8ae8-4db8-485d-9031-3a64e1318456 req-a7206de5-70c7-4807-8a6e-716a7feb3214 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:17:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updated VIF entry in instance network info cache for port 45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:17:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2f599ccd-f639-416e-a3fc-18612ec9401f req-f12678fa-3f32-435e-a311-be29d9fde7b6 service nova] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:17:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-58ce59c9-af84-4592-8652-790b8a33214e tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:39 user nova-compute[75244]: WARNING nova.compute.manager [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state active and task_state None.
Nov 29 23:17:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:39 user nova-compute[75244]: WARNING nova.compute.manager [req-71f1d0b9-59e4-4f92-9c03-f4617bf69895 req-a041826a-ebc4-41a7-b104-8deccfb466c2 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state active and task_state None.
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:17:39 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:17:40 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [{"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:17:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-34b60257-6546-447b-8b6d-f95eb0fdab74" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:17:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:17:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:17:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 is timed out.
Nov 29 23:17:45 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully detached device vdb from instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 from the live domain config.
Nov 29 23:17:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnpPSNaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[873e7917-3bda-4d68-98df-1496acfd1422]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:17:45 user nova-compute[75244]: No targets found.
Nov 29 23:17:45 user nova-compute[75244]: iSNS:
Nov 29 23:17:45 user nova-compute[75244]: No targets found.
Nov 29 23:17:45 user nova-compute[75244]: STATIC:
Nov 29 23:17:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:17:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:17:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:17:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4
Nov 29 23:17:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:45 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:17:45 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:45 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:45 user nova-compute[75244]: FIRMWARE:
Nov 29 23:17:45 user nova-compute[75244]: No targets found.
Nov 29 23:17:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:17:45 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:17:45 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d220ab42-bf7f-4ab3-b10e-33c6d9302390]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e311f804-9550-478a-a65a-1c1ed391bd81]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 (non-flash)
Nov 29 23:17:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:45 user nova-compute[75244]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 (non-flash)
Nov 29 23:17:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4'): ({'sdg'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Removing single pathed devices sdg {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa2c7d9-8d66-4577-b097-65d55e90a588]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[47092f0e-a436-4861-bea9-293d4bcf9635]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Flushing IO for device /dev/sdg {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:17:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f2e72-132c-4160-9690-493fda6dcfaa]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cdd8d1-0dbf-46cd-bc63-638df05d7a3e]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] SCSI volumes sdg have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae524c8-d7c1-4fea-943e-edb711f9bf99]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.141s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619b41d-4d3a-49bb-b474-6fb7d367964e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260]
Nov 29 23:17:46 user nova-compute[75244]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4, portal: 172.16.0.220,3260] successful.
Nov 29 23:17:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a5a6b8-89de-4054-b689-dbb09ce9dcd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecba297c-b384-463e-a686-c2bf07a4042d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] <== disconnect_volume: return (487ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'flavor' on Instance uuid 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b39e6275-e084-4811-a6a3-2920a3b053d2 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.077s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:17:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=24.83373260498047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7156169f-5668-49cb-93dc-35009dfff4c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:17:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:52 user nova-compute[75244]: INFO nova.compute.manager [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Terminating instance
Nov 29 23:17:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-c4a6fb8b-500a-482c-9e31-b1b55baf34a8 req-2efabe5c-97d6-41d4-a8d3-5ebc14c85d9e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c4a6fb8b-500a-482c-9e31-b1b55baf34a8 req-2efabe5c-97d6-41d4-a8d3-5ebc14c85d9e service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c4a6fb8b-500a-482c-9e31-b1b55baf34a8 req-2efabe5c-97d6-41d4-a8d3-5ebc14c85d9e service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c4a6fb8b-500a-482c-9e31-b1b55baf34a8 req-2efabe5c-97d6-41d4-a8d3-5ebc14c85d9e service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-c4a6fb8b-500a-482c-9e31-b1b55baf34a8 req-2efabe5c-97d6-41d4-a8d3-5ebc14c85d9e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-c4a6fb8b-500a-482c-9e31-b1b55baf34a8 req-2efabe5c-97d6-41d4-a8d3-5ebc14c85d9e service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-unplugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:17:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Instance destroyed successfully.
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lazy-loading 'resources' on Instance uuid 7156169f-5668-49cb-93dc-35009dfff4c4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986679095',display_name='tempest-ServerActionsTestOtherB-server-986679095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986679095',id=21,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJH0rMOLDIHEGHtXnKQ9GGyA++ZGZ/nMW7wKe8O5S3gew6ZFUpCLoQqAhARIQSVDEtSCn+LVZ3PyGuMaGBgwkZ4WbGk5C9B3N3TU0QP/wXigyH30qUGCDNcTtamdYY4bA==',key_name='tempest-keypair-540952667',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2752170d04b4e3da54e0f7aa8d57e94',ramdisk_id='',reservation_id='r-cgx745jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1460963367',owner_user_name='tempest-ServerActionsTestOtherB-1460963367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c42ce8eec4d1da0554d4797bde030',uuid=7156169f-5668-49cb-93dc-35009dfff4c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converting VIF {"id": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "address": "fa:16:3e:79:3f:62", "network": {"id": "177c23a6-3129-4109-879d-29dca17de482", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-79574040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2752170d04b4e3da54e0f7aa8d57e94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb2df2b-51", "ovs_interfaceid": "beb2df2b-5192-4d17-8e62-09c480ce6e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_vif [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeb2df2b-51, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ce3280a-8361-406b-80d1-fc418accfd43) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:53 user nova-compute[75244]: INFO os_vif [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:3f:62,bridge_name='br-int',has_traffic_filtering=True,id=beb2df2b-5192-4d17-8e62-09c480ce6e36,network=Network(177c23a6-3129-4109-879d-29dca17de482),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb2df2b-51')
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQwCaIxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:17:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5c3a6-f125-4dbe-a9c3-a9e37d4eeacc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:17:53 user nova-compute[75244]: No targets found.
Nov 29 23:17:53 user nova-compute[75244]: iSNS:
Nov 29 23:17:53 user nova-compute[75244]: No targets found.
Nov 29 23:17:53 user nova-compute[75244]: STATIC:
Nov 29 23:17:53 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:17:53 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:53 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:53 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c
Nov 29 23:17:53 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:53 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:53 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:17:53 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:53 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:53 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:17:53 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:17:53 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:17:53 user nova-compute[75244]: FIRMWARE:
Nov 29 23:17:53 user nova-compute[75244]: No targets found.
Nov 29 23:17:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:17:53 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:17:53 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[58150e85-d98e-4ba8-8c91-04777a41c187]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f90db-b155-4294-93d3-791f99ea885d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:53 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:53 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:53 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:17:53 user nova-compute[75244]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c (non-flash)
Nov 29 23:17:53 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:17:53 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:17:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043ef490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda2465e-5edc-4f1f-82aa-e6035e10c38e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ce409c-8073-4d0d-9d6b-f07df94fb07b]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a212cf-dab5-439d-84a0-023a18d4734e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad085979-621e-4dad-aed8-558f182dda87]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aa3b15-bfeb-447c-9ab2-13295ba50f45]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[964714e8-1ce6-422d-b01e-a6c4a2324e6c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260]
Nov 29 23:17:53 user nova-compute[75244]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:17:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed984e2b-1b00-4864-80a3-22b6d3092a3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a7b780-5521-4e8f-91bb-e70ee1f43f51]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] <== disconnect_volume: return (299ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:17:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Deleting instance files /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4_del
Nov 29 23:17:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Deletion of /opt/stack/data/nova/instances/7156169f-5668-49cb-93dc-35009dfff4c4_del complete
Nov 29 23:17:53 user nova-compute[75244]: INFO nova.compute.manager [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 29 23:17:53 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:17:53 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:17:54 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:17:54 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Took 0.76 seconds to deallocate network for instance.
Nov 29 23:17:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-23d4bded-990f-4e27-ad2f-1c424c256e28 req-e0efafd4-9500-4aa7-b882-d5a3a6e446b6 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-deleted-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-ca7bf3f8-c95b-4aef-8b07-3d09bab11c5c req-e7f88ed4-567c-4edc-b0db-c2c2e56dd7d0 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:17:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ca7bf3f8-c95b-4aef-8b07-3d09bab11c5c req-e7f88ed4-567c-4edc-b0db-c2c2e56dd7d0 service nova] Acquiring lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ca7bf3f8-c95b-4aef-8b07-3d09bab11c5c req-e7f88ed4-567c-4edc-b0db-c2c2e56dd7d0 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ca7bf3f8-c95b-4aef-8b07-3d09bab11c5c req-e7f88ed4-567c-4edc-b0db-c2c2e56dd7d0 service nova] Lock "7156169f-5668-49cb-93dc-35009dfff4c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-ca7bf3f8-c95b-4aef-8b07-3d09bab11c5c req-e7f88ed4-567c-4edc-b0db-c2c2e56dd7d0 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] No waiting events found dispatching network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:17:54 user nova-compute[75244]: WARNING nova.compute.manager [req-ca7bf3f8-c95b-4aef-8b07-3d09bab11c5c req-e7f88ed4-567c-4edc-b0db-c2c2e56dd7d0 service nova] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Received unexpected event network-vif-plugged-beb2df2b-5192-4d17-8e62-09c480ce6e36 for instance with vm_state active and task_state deleting.
Nov 29 23:17:55 user nova-compute[75244]: INFO nova.compute.manager [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] [instance: 7156169f-5668-49cb-93dc-35009dfff4c4] Took 0.84 seconds to detach 1 volumes for instance.
Nov 29 23:17:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:17:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:17:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:17:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:17:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:55 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Deleted allocations for instance 7156169f-5668-49cb-93dc-35009dfff4c4
Nov 29 23:17:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c9929d92-3ed9-4597-9fe0-49e6793407d1 tempest-ServerActionsTestOtherB-1460963367 tempest-ServerActionsTestOtherB-1460963367-project-member] Lock "7156169f-5668-49cb-93dc-35009dfff4c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.295s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:17:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:17:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:06 user nova-compute[75244]: INFO nova.compute.manager [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Detaching volume d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:18:06 user nova-compute[75244]: INFO nova.virt.block_device [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Attempting to driver detach volume d3f9d21d-8d4b-45af-8e1a-34af33996800 from mountpoint /dev/vdb
Nov 29 23:18:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Attempting to detach device vdb from instance 34b60257-6546-447b-8b6d-f95eb0fdab74 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:18:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:18:06 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:18:06 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:18:06 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:18:06 user nova-compute[75244]:   <serial>d3f9d21d-8d4b-45af-8e1a-34af33996800</serial>
Nov 29 23:18:06 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:18:06 user nova-compute[75244]: </disk>
Nov 29 23:18:06 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:18:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Successfully detached device vdb from instance 34b60257-6546-447b-8b6d-f95eb0fdab74 from the persistent domain config.
Nov 29 23:18:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34b60257-6546-447b-8b6d-f95eb0fdab74 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:18:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:18:06 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:18:06 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:18:06 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:18:06 user nova-compute[75244]:   <serial>d3f9d21d-8d4b-45af-8e1a-34af33996800</serial>
Nov 29 23:18:06 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:18:06 user nova-compute[75244]: </disk>
Nov 29 23:18:06 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:18:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:18:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid e568eb15-8140-486d-a8a9-a2b5e726ad60 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:15 user nova-compute[75244]: INFO nova.compute.manager [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Terminating instance
Nov 29 23:18:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc307a3b-9992-45a1-a870-cbbc7c5cef83 req-5f93eca1-a323-43ca-8cfc-e22d247d96e9 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-vif-unplugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc307a3b-9992-45a1-a870-cbbc7c5cef83 req-5f93eca1-a323-43ca-8cfc-e22d247d96e9 service nova] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc307a3b-9992-45a1-a870-cbbc7c5cef83 req-5f93eca1-a323-43ca-8cfc-e22d247d96e9 service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc307a3b-9992-45a1-a870-cbbc7c5cef83 req-5f93eca1-a323-43ca-8cfc-e22d247d96e9 service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc307a3b-9992-45a1-a870-cbbc7c5cef83 req-5f93eca1-a323-43ca-8cfc-e22d247d96e9 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] No waiting events found dispatching network-vif-unplugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc307a3b-9992-45a1-a870-cbbc7c5cef83 req-5f93eca1-a323-43ca-8cfc-e22d247d96e9 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-vif-unplugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Instance destroyed successfully.
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lazy-loading 'resources' on Instance uuid 7acb45a6-a508-423e-9b1f-b93a29ab5da9 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1845313309',display_name='tempest-AttachVolumeNegativeTest-server-1845313309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1845313309',id=30,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPwgv3R1FgYLMCU4DYyt7XLaPGUMuqzPp7HIlcM2fQ1IfCY3oHZh5Kh6G1d4fXTO1WoSCSdtk3/Ei21+H/5ozzAzNzBY6fflQnYP0p7DZR9Lj17zH8Jp4POAtDsmZkJvA==',key_name='tempest-keypair-1159852033',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f830c5f8f3641f1938b103eae582ccd',ramdisk_id='',reservation_id='r-v61959fi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-750809743',owner_user_name='tempest-AttachVolumeNegativeTest-750809743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:15:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbdba67b1fdb470194c5a15ee3c4baee',uuid=7acb45a6-a508-423e-9b1f-b93a29ab5da9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converting VIF {"id": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "address": "fa:16:3e:2f:ef:7a", "network": {"id": "e0636224-99ca-4627-917e-7f6ffe1fac05", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1672431582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f830c5f8f3641f1938b103eae582ccd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6d1a11-8d", "ovs_interfaceid": "4d6d1a11-8d34-413f-ae0f-b304f2812e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG os_vif [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d6d1a11-8d, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2967f3f3-c16d-4ead-843c-ae83de4fc3be) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:16 user nova-compute[75244]: INFO os_vif [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:ef:7a,bridge_name='br-int',has_traffic_filtering=True,id=4d6d1a11-8d34-413f-ae0f-b304f2812e38,network=Network(e0636224-99ca-4627-917e-7f6ffe1fac05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6d1a11-8d')
Nov 29 23:18:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Deleting instance files /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9_del
Nov 29 23:18:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Deletion of /opt/stack/data/nova/instances/7acb45a6-a508-423e-9b1f-b93a29ab5da9_del complete
Nov 29 23:18:16 user nova-compute[75244]: INFO nova.compute.manager [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 23:18:16 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:18:16 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:17 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Took 0.69 seconds to deallocate network for instance.
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-3fdd0f41-8af6-4e87-9c26-495bd3e6a713 req-1c1d3919-c82d-4ef9-9dfd-bedbe1ca4dc3 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-vif-deleted-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:18:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:17 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Deleted allocations for instance 7acb45a6-a508-423e-9b1f-b93a29ab5da9
Nov 29 23:18:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d8db8df1-2709-4cb8-8ad1-b9034756bb98 tempest-AttachVolumeNegativeTest-750809743 tempest-AttachVolumeNegativeTest-750809743-project-member] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-d9bc95e0-259e-46cf-966b-7214c9bd3183 req-2a209d0e-ce4e-4919-ab01-503dea3b3a80 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received event network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d9bc95e0-259e-46cf-966b-7214c9bd3183 req-2a209d0e-ce4e-4919-ab01-503dea3b3a80 service nova] Acquiring lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d9bc95e0-259e-46cf-966b-7214c9bd3183 req-2a209d0e-ce4e-4919-ab01-503dea3b3a80 service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d9bc95e0-259e-46cf-966b-7214c9bd3183 req-2a209d0e-ce4e-4919-ab01-503dea3b3a80 service nova] Lock "7acb45a6-a508-423e-9b1f-b93a29ab5da9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-d9bc95e0-259e-46cf-966b-7214c9bd3183 req-2a209d0e-ce4e-4919-ab01-503dea3b3a80 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] No waiting events found dispatching network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:18 user nova-compute[75244]: WARNING nova.compute.manager [req-d9bc95e0-259e-46cf-966b-7214c9bd3183 req-2a209d0e-ce4e-4919-ab01-503dea3b3a80 service nova] [instance: 7acb45a6-a508-423e-9b1f-b93a29ab5da9] Received unexpected event network-vif-plugged-4d6d1a11-8d34-413f-ae0f-b304f2812e38 for instance with vm_state deleted and task_state None.
Nov 29 23:18:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:18:23 user nova-compute[75244]: INFO nova.compute.claims [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Claim successful on node user
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:18:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.policy [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95d9846a47564c9caced77975fbd9ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf62fb1d72164f4883c82ccf7d601833', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:18:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Creating image(s)
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "/opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "/opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "/opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk 1073741824" returned: 0 in 0.057s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Successfully created port: 4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Cannot resize image /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Ensure instance console log exists: /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Successfully updated port: 4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "refresh_cache-434a4b52-a73d-47f7-938a-c7b30dcfc35f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquired lock "refresh_cache-434a4b52-a73d-47f7-938a-c7b30dcfc35f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.compute.manager [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-changed-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG nova.compute.manager [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Refreshing instance network info cache due to event network-changed-4485cd57-2365-497e-bb88-d5eb518748bc. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:18:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] Acquiring lock "refresh_cache-434a4b52-a73d-47f7-938a-c7b30dcfc35f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Updating instance_info_cache with network_info: [{"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Releasing lock "refresh_cache-434a4b52-a73d-47f7-938a-c7b30dcfc35f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Instance network_info: |[{"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] Acquired lock "refresh_cache-434a4b52-a73d-47f7-938a-c7b30dcfc35f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.neutron [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Refreshing network info cache for port 4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Start _get_guest_xml network_info=[{"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:18:25 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:18:25 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1806778782',display_name='tempest-VolumesActionsTest-instance-1806778782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1806778782',id=33,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf62fb1d72164f4883c82ccf7d601833',ramdisk_id='',reservation_id='r-a95b1mil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1332048055',owner_user_name='tempest-VolumesActionsTest-1332048055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:18:24Z,user_data=None,user_id='95d9846a47564c9caced77975fbd9ebc',uuid=434a4b52-a73d-47f7-938a-c7b30dcfc35f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Converting VIF {"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lazy-loading 'pci_devices' on Instance uuid 434a4b52-a73d-47f7-938a-c7b30dcfc35f {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:18:25 user nova-compute[75244]:   <uuid>434a4b52-a73d-47f7-938a-c7b30dcfc35f</uuid>
Nov 29 23:18:25 user nova-compute[75244]:   <name>instance-00000021</name>
Nov 29 23:18:25 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:18:25 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:18:25 user nova-compute[75244]:   <metadata>
Nov 29 23:18:25 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:18:25 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:18:25 user nova-compute[75244]:       <nova:name>tempest-VolumesActionsTest-instance-1806778782</nova:name>
Nov 29 23:18:25 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:18:25</nova:creationTime>
Nov 29 23:18:25 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:18:25 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:18:25 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:18:25 user nova-compute[75244]:       <nova:owner>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:user uuid="95d9846a47564c9caced77975fbd9ebc">tempest-VolumesActionsTest-1332048055-project-member</nova:user>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:project uuid="cf62fb1d72164f4883c82ccf7d601833">tempest-VolumesActionsTest-1332048055</nova:project>
Nov 29 23:18:25 user nova-compute[75244]:       </nova:owner>
Nov 29 23:18:25 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:18:25 user nova-compute[75244]:       <nova:ports>
Nov 29 23:18:25 user nova-compute[75244]:         <nova:port uuid="4485cd57-2365-497e-bb88-d5eb518748bc">
Nov 29 23:18:25 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 23:18:25 user nova-compute[75244]:         </nova:port>
Nov 29 23:18:25 user nova-compute[75244]:       </nova:ports>
Nov 29 23:18:25 user nova-compute[75244]:     </nova:instance>
Nov 29 23:18:25 user nova-compute[75244]:   </metadata>
Nov 29 23:18:25 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:18:25 user nova-compute[75244]:     <system>
Nov 29 23:18:25 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:18:25 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:18:25 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:18:25 user nova-compute[75244]:       <entry name="serial">434a4b52-a73d-47f7-938a-c7b30dcfc35f</entry>
Nov 29 23:18:25 user nova-compute[75244]:       <entry name="uuid">434a4b52-a73d-47f7-938a-c7b30dcfc35f</entry>
Nov 29 23:18:25 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:18:25 user nova-compute[75244]:     </system>
Nov 29 23:18:25 user nova-compute[75244]:   </sysinfo>
Nov 29 23:18:25 user nova-compute[75244]:   <os>
Nov 29 23:18:25 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:18:25 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:18:25 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:18:25 user nova-compute[75244]:   </os>
Nov 29 23:18:25 user nova-compute[75244]:   <features>
Nov 29 23:18:25 user nova-compute[75244]:     <acpi/>
Nov 29 23:18:25 user nova-compute[75244]:     <apic/>
Nov 29 23:18:25 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:18:25 user nova-compute[75244]:   </features>
Nov 29 23:18:25 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:18:25 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:18:25 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:18:25 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:18:25 user nova-compute[75244]:   </clock>
Nov 29 23:18:25 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:18:25 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:18:25 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:18:25 user nova-compute[75244]:   </cpu>
Nov 29 23:18:25 user nova-compute[75244]:   <devices>
Nov 29 23:18:25 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:18:25 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:18:25 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk"/>
Nov 29 23:18:25 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:18:25 user nova-compute[75244]:     </disk>
Nov 29 23:18:25 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:18:25 user nova-compute[75244]:       <mac address="fa:16:3e:e2:2d:73"/>
Nov 29 23:18:25 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:18:25 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:18:25 user nova-compute[75244]:       <target dev="tap4485cd57-23"/>
Nov 29 23:18:25 user nova-compute[75244]:     </interface>
Nov 29 23:18:25 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:18:25 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/console.log" append="off"/>
Nov 29 23:18:25 user nova-compute[75244]:     </serial>
Nov 29 23:18:25 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:18:25 user nova-compute[75244]:     <video>
Nov 29 23:18:25 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:18:25 user nova-compute[75244]:     </video>
Nov 29 23:18:25 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:18:25 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:18:25 user nova-compute[75244]:     </rng>
Nov 29 23:18:25 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:18:25 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:18:25 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:18:25 user nova-compute[75244]:     </memballoon>
Nov 29 23:18:25 user nova-compute[75244]:   </devices>
Nov 29 23:18:25 user nova-compute[75244]: </domain>
Nov 29 23:18:25 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1806778782',display_name='tempest-VolumesActionsTest-instance-1806778782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1806778782',id=33,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf62fb1d72164f4883c82ccf7d601833',ramdisk_id='',reservation_id='r-a95b1mil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1332048055',owner_user_name='tempest-VolumesActionsTest-1332048055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:18:24Z,user_data=None,user_id='95d9846a47564c9caced77975fbd9ebc',uuid=434a4b52-a73d-47f7-938a-c7b30dcfc35f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Converting VIF {"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG os_vif [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b758cd3-768c-57bf-b96b-ef0c56cfd6dc', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4485cd57-23, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4485cd57-23, col_values=(('qos', UUID('3cb5106a-44ea-4e51-ac1f-bc434948b331')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4485cd57-23, col_values=(('external_ids', {'iface-id': '4485cd57-2365-497e-bb88-d5eb518748bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:2d:73', 'vm-uuid': '434a4b52-a73d-47f7-938a-c7b30dcfc35f'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:25 user nova-compute[75244]: INFO os_vif [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23')
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] No VIF found with MAC fa:16:3e:e2:2d:73, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.neutron [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Updated VIF entry in instance network info cache for port 4485cd57-2365-497e-bb88-d5eb518748bc. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG nova.network.neutron [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Updating instance_info_cache with network_info: [{"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-02246488-b05c-4e69-9b19-5ab8fb5c6a0c req-d490e155-6f64-4637-9d6d-92ef6fdf54fa service nova] Releasing lock "refresh_cache-434a4b52-a73d-47f7-938a-c7b30dcfc35f" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:18:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc57803e-b60e-4079-be6e-77e48906655a req-98766f95-7317-4d3a-98bc-872be0179ba4 service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc57803e-b60e-4079-be6e-77e48906655a req-98766f95-7317-4d3a-98bc-872be0179ba4 service nova] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc57803e-b60e-4079-be6e-77e48906655a req-98766f95-7317-4d3a-98bc-872be0179ba4 service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cc57803e-b60e-4079-be6e-77e48906655a req-98766f95-7317-4d3a-98bc-872be0179ba4 service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG nova.compute.manager [req-cc57803e-b60e-4079-be6e-77e48906655a req-98766f95-7317-4d3a-98bc-872be0179ba4 service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] No waiting events found dispatching network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:27 user nova-compute[75244]: WARNING nova.compute.manager [req-cc57803e-b60e-4079-be6e-77e48906655a req-98766f95-7317-4d3a-98bc-872be0179ba4 service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received unexpected event network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc for instance with vm_state building and task_state spawning.
Nov 29 23:18:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34b60257-6546-447b-8b6d-f95eb0fdab74 is timed out.
Nov 29 23:18:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Successfully detached device vdb from instance 34b60257-6546-447b-8b6d-f95eb0fdab74 from the live domain config.
Nov 29 23:18:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSUyOaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:18:27 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2ad1ca-179c-408f-95e0-fd3286ec7ad2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:18:27 user nova-compute[75244]: No targets found.
Nov 29 23:18:27 user nova-compute[75244]: iSNS:
Nov 29 23:18:27 user nova-compute[75244]: No targets found.
Nov 29 23:18:27 user nova-compute[75244]: STATIC:
Nov 29 23:18:27 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800
Nov 29 23:18:27 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:18:27 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:18:27 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:18:27 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:18:27 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:18:27 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:18:27 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:18:27 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:18:27 user nova-compute[75244]: FIRMWARE:
Nov 29 23:18:27 user nova-compute[75244]: No targets found.
Nov 29 23:18:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:18:27 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:18:27 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d60635-d687-4cf9-b65d-a4bc387e43f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[09486ed2-dcbf-4061-9286-679c587c9027]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:27 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:18:27 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:27 user nova-compute[75244]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 (non-flash)
Nov 29 23:18:27 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8041e9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc8ed09-6b1d-4ec9-97ca-210f917d62ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1277a-c84e-4535-b17c-04085c26b8ab]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf313909-3e6c-478a-8eb4-701f9cc5112c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d0f4d2-a1e3-46c3-9a27-ee8fc0c39f4c]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4cfc52-34be-4cba-80a5-8a07c7430188]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ebcffc-b407-42fa-bfd7-8341864b68f2]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260]
Nov 29 23:18:27 user nova-compute[75244]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800, portal: 172.16.0.220,3260] successful.
Nov 29 23:18:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f9d21d-8d4b-45af-8e1a-34af33996800 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2cf658-91e7-4850-bb3f-49c8214a3429]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] <== disconnect_volume: return (308ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:18:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'flavor' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cfc0cc43-fc7c-4d97-909d-ec81073adbad tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.602s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:28 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Instance spawned successfully.
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:18:28 user nova-compute[75244]: INFO nova.compute.claims [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Claim successful on node user
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:29 user nova-compute[75244]: INFO nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-a3ea1bc1-9e48-45ac-a625-9a570610c54e req-10d88bdc-3587-45d7-a9f8-7099ec947a5f service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a3ea1bc1-9e48-45ac-a625-9a570610c54e req-10d88bdc-3587-45d7-a9f8-7099ec947a5f service nova] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a3ea1bc1-9e48-45ac-a625-9a570610c54e req-10d88bdc-3587-45d7-a9f8-7099ec947a5f service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a3ea1bc1-9e48-45ac-a625-9a570610c54e req-10d88bdc-3587-45d7-a9f8-7099ec947a5f service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-a3ea1bc1-9e48-45ac-a625-9a570610c54e req-10d88bdc-3587-45d7-a9f8-7099ec947a5f service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] No waiting events found dispatching network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:29 user nova-compute[75244]: WARNING nova.compute.manager [req-a3ea1bc1-9e48-45ac-a625-9a570610c54e req-10d88bdc-3587-45d7-a9f8-7099ec947a5f service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received unexpected event network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc for instance with vm_state building and task_state spawning.
Nov 29 23:18:29 user nova-compute[75244]: INFO nova.compute.manager [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Took 5.98 seconds to build instance.
Nov 29 23:18:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6a1ee5bb-3251-446d-a21c-fd8d40f822a8 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.089s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:18:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:18:29 user nova-compute[75244]: DEBUG nova.policy [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2a16d9d8a414de4b6621acd12b89aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9595b50731fc44ae85e99ded8dbbaf61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:18:29 user nova-compute[75244]: INFO nova.virt.block_device [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Booting with volume-backed-image bb216299-2134-4398-939c-137bca845056 at /dev/vda
Nov 29 23:18:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Successfully created port: 602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:18:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Successfully updated port: 602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:18:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:18:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:18:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-changed-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Refreshing instance network info cache due to event network-changed-602929c7-87cd-4cfe-9e23-ba81c6e54c26. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] Acquiring lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.network.neutron [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating instance_info_cache with network_info: [{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance network_info: |[{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] Acquired lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Refreshing network info cache for port 602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updated VIF entry in instance network info cache for port 602929c7-87cd-4cfe-9e23-ba81c6e54c26. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating instance_info_cache with network_info: [{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-92226ae1-0103-4204-821a-4a23c6316b61 req-997411c1-5e48-4bc6-8a74-bd28cf8c1144 service nova] Releasing lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG os_brick.utils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1829051e-5599-41c7-b1b3-675daccc1d2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ddca9-07ac-4ce1-ad63-983c366e50d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894f6b0-1505-4d0e-945a-685e4de484e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[885a667f-2506-4230-a445-4641c4b9688f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:18:35 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:18:35 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[048eee3a-4613-4e6a-bded-ffd9bce363bb]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG os_brick.utils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating existing volume attachment record: 0231b3ab-bcfa-4833-bdce-903a1404285c {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-changed-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Refreshing instance network info cache due to event network-changed-99a1270e-6789-4836-b124-3bf904239ba2. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] Acquiring lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] Acquired lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Refreshing network info cache for port 99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'flavor' on Instance uuid 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updated VIF entry in instance network info cache for port 99a1270e-6789-4836-b124-3bf904239ba2. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating instance_info_cache with network_info: [{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d7997246-7a47-453e-88d9-3137c82d8079 req-30ad98be-35f2-4a38-82e4-b42ca89a57d9 service nova] Releasing lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:40 user nova-compute[75244]: INFO nova.compute.manager [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Attaching volume 603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 to /dev/vdb
Nov 29 23:18:41 user nova-compute[75244]: DEBUG os_brick.utils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8497a477-aa4b-45c6-98a8-acfca431e140]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76db428-274c-44e3-a482-62ec7d575b52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8126dbe7-2bfe-41b4-bb44-6bebf0b35811]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc423baa-506e-44e8-bb77-abf5c7e3d730]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:18:41 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d4af77-d3d1-4d8b-bea1-cd15f0c2d7ce]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG os_brick.utils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating existing volume attachment record: c8902672-e8df-49dd-9561-ad5594b542b3 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:18:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:18:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Creating image(s)
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Ensure instance console log exists: /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Start _get_guest_xml network_info=[{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34c3ab5b-1a14-4756-8909-3b0c66b6a8b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'serial': 'ecdf8c9d-af01-46a4-b6f7-cf825a706793'}, 'attachment_id': '0231b3ab-bcfa-4833-bdce-903a1404285c', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:18:43 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:18:43 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:18:43 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:18:43 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:18:43 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603ae16-a2e5-4494-a390-07754408849e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:18:43 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d181bb8f-4f07-4e28-a513-5067022d968c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793] added
Nov 29 23:18:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c7bdd8-9b45-4dc6-8a42-e514c6c6b6d7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[699eb90b-abb9-4b53-99cf-67d43750a0ae]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuGSFOcs {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuGSFOcs" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2714a8f-0aed-4456-934a-f92cf9d59a82]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UuGSFOcs'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd8be67-7f2d-44e5-8102-582015dcc030]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee73fb9-36f2-4cc9-af71-3c12247862a8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:43 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:43 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[27109a17-40a3-416e-a09f-db37c4f9f80f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260]
Nov 29 23:18:43 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260] successful.
Nov 29 23:18:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b45780-a6d7-4a8c-87e2-7bfb9126ed7e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[60428347-5632-4491-89a4-d399e24c6d17]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:43 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:43 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:18:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:43 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:43 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:18:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb46cfd-01b7-470b-b4a8-fc62a940352f]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:18:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23663313163626137', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663313163626137', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1256519036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1256519036',id=34,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-7t6km07m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:18:29Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=34c3ab5b-1a14-4756-8909-3b0c66b6a8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'pci_devices' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:18:44 user nova-compute[75244]:   <uuid>34c3ab5b-1a14-4756-8909-3b0c66b6a8b4</uuid>
Nov 29 23:18:44 user nova-compute[75244]:   <name>instance-00000022</name>
Nov 29 23:18:44 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:18:44 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:18:44 user nova-compute[75244]:   <metadata>
Nov 29 23:18:44 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:18:44 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:18:44 user nova-compute[75244]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1256519036</nova:name>
Nov 29 23:18:44 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:18:43</nova:creationTime>
Nov 29 23:18:44 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:18:44 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:18:44 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:18:44 user nova-compute[75244]:       <nova:owner>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:user uuid="c2a16d9d8a414de4b6621acd12b89aa0">tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member</nova:user>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:project uuid="9595b50731fc44ae85e99ded8dbbaf61">tempest-ServerBootFromVolumeStableRescueTest-1262475948</nova:project>
Nov 29 23:18:44 user nova-compute[75244]:       </nova:owner>
Nov 29 23:18:44 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:18:44 user nova-compute[75244]:       <nova:ports>
Nov 29 23:18:44 user nova-compute[75244]:         <nova:port uuid="602929c7-87cd-4cfe-9e23-ba81c6e54c26">
Nov 29 23:18:44 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 23:18:44 user nova-compute[75244]:         </nova:port>
Nov 29 23:18:44 user nova-compute[75244]:       </nova:ports>
Nov 29 23:18:44 user nova-compute[75244]:     </nova:instance>
Nov 29 23:18:44 user nova-compute[75244]:   </metadata>
Nov 29 23:18:44 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:18:44 user nova-compute[75244]:     <system>
Nov 29 23:18:44 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:18:44 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:18:44 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:18:44 user nova-compute[75244]:       <entry name="serial">34c3ab5b-1a14-4756-8909-3b0c66b6a8b4</entry>
Nov 29 23:18:44 user nova-compute[75244]:       <entry name="uuid">34c3ab5b-1a14-4756-8909-3b0c66b6a8b4</entry>
Nov 29 23:18:44 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:18:44 user nova-compute[75244]:     </system>
Nov 29 23:18:44 user nova-compute[75244]:   </sysinfo>
Nov 29 23:18:44 user nova-compute[75244]:   <os>
Nov 29 23:18:44 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:18:44 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:18:44 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:18:44 user nova-compute[75244]:   </os>
Nov 29 23:18:44 user nova-compute[75244]:   <features>
Nov 29 23:18:44 user nova-compute[75244]:     <acpi/>
Nov 29 23:18:44 user nova-compute[75244]:     <apic/>
Nov 29 23:18:44 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:18:44 user nova-compute[75244]:   </features>
Nov 29 23:18:44 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:18:44 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:18:44 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:18:44 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:18:44 user nova-compute[75244]:   </clock>
Nov 29 23:18:44 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:18:44 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:18:44 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:18:44 user nova-compute[75244]:   </cpu>
Nov 29 23:18:44 user nova-compute[75244]:   <devices>
Nov 29 23:18:44 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:18:44 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:18:44 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:18:44 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:18:44 user nova-compute[75244]:       <serial>ecdf8c9d-af01-46a4-b6f7-cf825a706793</serial>
Nov 29 23:18:44 user nova-compute[75244]:     </disk>
Nov 29 23:18:44 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:18:44 user nova-compute[75244]:       <mac address="fa:16:3e:94:6c:41"/>
Nov 29 23:18:44 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:18:44 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:18:44 user nova-compute[75244]:       <target dev="tap602929c7-87"/>
Nov 29 23:18:44 user nova-compute[75244]:     </interface>
Nov 29 23:18:44 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:18:44 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/console.log" append="off"/>
Nov 29 23:18:44 user nova-compute[75244]:     </serial>
Nov 29 23:18:44 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:18:44 user nova-compute[75244]:     <video>
Nov 29 23:18:44 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:18:44 user nova-compute[75244]:     </video>
Nov 29 23:18:44 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:18:44 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:18:44 user nova-compute[75244]:     </rng>
Nov 29 23:18:44 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:18:44 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:18:44 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:18:44 user nova-compute[75244]:     </memballoon>
Nov 29 23:18:44 user nova-compute[75244]:   </devices>
Nov 29 23:18:44 user nova-compute[75244]: </domain>
Nov 29 23:18:44 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1256519036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1256519036',id=34,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-7t6km07m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:18:29Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=34c3ab5b-1a14-4756-8909-3b0c66b6a8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG os_vif [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '003870b6-4a2e-51c7-8078-de3f7d79e3d8', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap602929c7-87, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap602929c7-87, col_values=(('qos', UUID('320ac638-5046-4988-9b89-b57321baf944')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap602929c7-87, col_values=(('external_ids', {'iface-id': '602929c7-87cd-4cfe-9e23-ba81c6e54c26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:6c:41', 'vm-uuid': '34c3ab5b-1a14-4756-8909-3b0c66b6a8b4'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:18:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:44 user nova-compute[75244]: INFO os_vif [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87')
Nov 29 23:18:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No VIF found with MAC fa:16:3e:94:6c:41, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:18:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-d44ccb22-ae0e-4065-a5b8-e67dd25b7deb req-7ff847f7-d05d-4f12-998c-8f846bf991bf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d44ccb22-ae0e-4065-a5b8-e67dd25b7deb req-7ff847f7-d05d-4f12-998c-8f846bf991bf service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d44ccb22-ae0e-4065-a5b8-e67dd25b7deb req-7ff847f7-d05d-4f12-998c-8f846bf991bf service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d44ccb22-ae0e-4065-a5b8-e67dd25b7deb req-7ff847f7-d05d-4f12-998c-8f846bf991bf service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-d44ccb22-ae0e-4065-a5b8-e67dd25b7deb req-7ff847f7-d05d-4f12-998c-8f846bf991bf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:46 user nova-compute[75244]: WARNING nova.compute.manager [req-d44ccb22-ae0e-4065-a5b8-e67dd25b7deb req-7ff847f7-d05d-4f12-998c-8f846bf991bf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state building and task_state spawning.
Nov 29 23:18:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:18:48 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance spawned successfully.
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-40baf93c-2486-4cbb-a2e3-2577ab05e6ea req-a2c8be73-716b-4393-a058-b910718227cf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-40baf93c-2486-4cbb-a2e3-2577ab05e6ea req-a2c8be73-716b-4393-a058-b910718227cf service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-40baf93c-2486-4cbb-a2e3-2577ab05e6ea req-a2c8be73-716b-4393-a058-b910718227cf service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-40baf93c-2486-4cbb-a2e3-2577ab05e6ea req-a2c8be73-716b-4393-a058-b910718227cf service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.compute.manager [req-40baf93c-2486-4cbb-a2e3-2577ab05e6ea req-a2c8be73-716b-4393-a058-b910718227cf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:48 user nova-compute[75244]: WARNING nova.compute.manager [req-40baf93c-2486-4cbb-a2e3-2577ab05e6ea req-a2c8be73-716b-4393-a058-b910718227cf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state building and task_state spawning.
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:48 user nova-compute[75244]: INFO nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 29 23:18:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:18:48 user nova-compute[75244]: INFO nova.compute.manager [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Took 19.89 seconds to build instance.
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ea053a00-99ff-464f-ae82-10a0f36b0c33 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.998s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRlaTkLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:18:50 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:18:50 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:18:50 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:18:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7949MB free_disk=24.84960174560547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3cb66b-5fe3-4166-911f-88e82f830503]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:18:50 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[28723931-d900-4c27-8aca-a5cffacc853d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78] added
Nov 29 23:18:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cee086-49b8-46ce-a54f-efcbe89ce644]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda0b84d-3738-4916-b2e9-f68826cf518d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRlaTkLw {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRlaTkLw" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f96596-5ae0-4a56-92c4-2efb7c462860]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRlaTkLw'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e414be3-75e9-4a35-b002-7c98539ec961]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa37c9-a6e4-40a2-ae89-7a5208dccad1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:18:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:18:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34b60257-6546-447b-8b6d-f95eb0fdab74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 434a4b52-a73d-47f7-938a-c7b30dcfc35f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dee3cb0-6d61-4e5e-8523-25bcbfa302a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260]
Nov 29 23:18:50 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260] successful.
Nov 29 23:18:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[761de7d3-a5ae-4f42-ae27-1e2cd30ac1d6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d94dbd-f7b9-44a7-a8c8-0ff007297f03]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 (non-flash)
Nov 29 23:18:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:18:50 user nova-compute[75244]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 (non-flash)
Nov 29 23:18:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a061f7c-0c02-4a9b-82da-daf7c1889ee4]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRlaTkLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23335363936383534', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335363936383534', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'flavor' on Instance uuid 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:18:51 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:18:51 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:18:51 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:18:51 user nova-compute[75244]:   <serial>603f1eee-a1ea-4d77-aa4c-f52d63bf0d78</serial>
Nov 29 23:18:51 user nova-compute[75244]: </disk>
Nov 29 23:18:51 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:18:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No VIF found with MAC fa:16:3e:35:52:ea, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:18:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c22b555b-2ba4-4136-897c-e970ce7ca7cc tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.121s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:18:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:18:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:54 user nova-compute[75244]: INFO nova.compute.manager [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Detaching volume 603f1eee-a1ea-4d77-aa4c-f52d63bf0d78
Nov 29 23:18:54 user nova-compute[75244]: INFO nova.virt.block_device [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Attempting to driver detach volume 603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 from mountpoint /dev/vdb
Nov 29 23:18:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Attempting to detach device vdb from instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:18:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:18:54 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:18:54 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:18:54 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:18:54 user nova-compute[75244]:   <serial>603f1eee-a1ea-4d77-aa4c-f52d63bf0d78</serial>
Nov 29 23:18:54 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:18:54 user nova-compute[75244]: </disk>
Nov 29 23:18:54 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:18:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully detached device vdb from instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 from the persistent domain config.
Nov 29 23:18:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:18:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:18:54 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:18:54 user nova-compute[75244]:   <source dev="/dev/sde"/>
Nov 29 23:18:54 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:18:54 user nova-compute[75244]:   <serial>603f1eee-a1ea-4d77-aa4c-f52d63bf0d78</serial>
Nov 29 23:18:54 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:18:54 user nova-compute[75244]: </disk>
Nov 29 23:18:54 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:18:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:18:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:57 user nova-compute[75244]: INFO nova.compute.manager [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Terminating instance
Nov 29 23:18:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-9b1d2f19-6bd7-4501-b21d-870c75741cb2 req-ee1c8547-31a0-4a6d-b4c3-803f58aa9e46 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9b1d2f19-6bd7-4501-b21d-870c75741cb2 req-ee1c8547-31a0-4a6d-b4c3-803f58aa9e46 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9b1d2f19-6bd7-4501-b21d-870c75741cb2 req-ee1c8547-31a0-4a6d-b4c3-803f58aa9e46 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9b1d2f19-6bd7-4501-b21d-870c75741cb2 req-ee1c8547-31a0-4a6d-b4c3-803f58aa9e46 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-9b1d2f19-6bd7-4501-b21d-870c75741cb2 req-ee1c8547-31a0-4a6d-b4c3-803f58aa9e46 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-9b1d2f19-6bd7-4501-b21d-870c75741cb2 req-ee1c8547-31a0-4a6d-b4c3-803f58aa9e46 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-unplugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:18:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Instance destroyed successfully.
Nov 29 23:18:58 user nova-compute[75244]: DEBUG nova.objects.instance [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lazy-loading 'resources' on Instance uuid 34b60257-6546-447b-8b6d-f95eb0fdab74 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1742931057',display_name='tempest-ServerStableDeviceRescueTest-server-1742931057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1742931057',id=27,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4iy9XOpg6wb+dg6ZZ/2USvuQHM/nvbg4P1hTn66BxDbA985JuwA6Q59dl4n8s39jN4tkY4GnppcNvcRJ2taMRdKZbqSsvx800GyTl8z+4LCC7vqSyh4wcQBO2HGSp+cw==',key_name='tempest-keypair-989750335',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cbbfa8e5fa4f18b3bcd03868aaab29',ramdisk_id='',reservation_id='r-2wc5z6sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-564661104',owner_user_name='tempest-ServerStableDeviceRescueTest-564661104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eb557daf278418793e7bb56882445f5',uuid=34b60257-6546-447b-8b6d-f95eb0fdab74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converting VIF {"id": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "address": "fa:16:3e:81:f3:0c", "network": {"id": "dec2cd14-875b-4d80-9e0b-c040ac275079", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1443362569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cbbfa8e5fa4f18b3bcd03868aaab29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45e66a9e-17", "ovs_interfaceid": "45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG os_vif [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45e66a9e-17, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c80f6ca-2f4f-4b95-babc-ee2cffa1a0ad) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:18:58 user nova-compute[75244]: INFO os_vif [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac,network=Network(dec2cd14-875b-4d80-9e0b-c040ac275079),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45e66a9e-17')
Nov 29 23:18:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Deleting instance files /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74_del
Nov 29 23:18:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Deletion of /opt/stack/data/nova/instances/34b60257-6546-447b-8b6d-f95eb0fdab74_del complete
Nov 29 23:18:58 user nova-compute[75244]: INFO nova.compute.manager [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 23:18:58 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:18:58 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:18:59 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Took 0.90 seconds to deallocate network for instance.
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:59 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Deleted allocations for instance 34b60257-6546-447b-8b6d-f95eb0fdab74
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-848400aa-6a0a-43e2-a445-acecb18a65d8 tempest-ServerStableDeviceRescueTest-564661104 tempest-ServerStableDeviceRescueTest-564661104-project-member] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] Acquiring lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] Lock "34b60257-6546-447b-8b6d-f95eb0fdab74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:18:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] No waiting events found dispatching network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:18:59 user nova-compute[75244]: WARNING nova.compute.manager [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received unexpected event network-vif-plugged-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac for instance with vm_state deleted and task_state None.
Nov 29 23:18:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d7dc666-8437-4c05-b861-24a02ca76df7 req-35b8e573-bc26-4204-a5db-b26d8b4780d6 service nova] [instance: 34b60257-6546-447b-8b6d-f95eb0fdab74] Received event network-vif-deleted-45e66a9e-1780-4bf9-b8b4-2c07ac4eeeac {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:19:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:15 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 is timed out.
Nov 29 23:19:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully detached device vdb from instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 from the live domain config.
Nov 29 23:19:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRlaTkLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:19:15 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[da01aa1f-21b6-4d2e-90ba-7754090ce7d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:19:15 user nova-compute[75244]: No targets found.
Nov 29 23:19:15 user nova-compute[75244]: iSNS:
Nov 29 23:19:15 user nova-compute[75244]: No targets found.
Nov 29 23:19:15 user nova-compute[75244]: STATIC:
Nov 29 23:19:15 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:19:15 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:19:15 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:19:15 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:19:15 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:19:15 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:19:15 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:19:15 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:19:15 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:19:15 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78
Nov 29 23:19:15 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:19:15 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:19:15 user nova-compute[75244]: FIRMWARE:
Nov 29 23:19:15 user nova-compute[75244]: No targets found.
Nov 29 23:19:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:19:15 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:19:15 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[764dad31-df76-47aa-b053-c052246b5d16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa891f12-c6ee-411c-8357-695b8ff6eb6e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:19:15 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:19:15 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:19:15 user nova-compute[75244]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 (non-flash)
Nov 29 23:19:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:19:15 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:19:15 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:19:15 user nova-compute[75244]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 (non-flash)
Nov 29 23:19:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c476dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[059be69d-1837-49eb-bdc2-fe7a90a27b6d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f2502-92ed-4625-a491-b7c3aa56bb1c]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc250638-59e9-42b4-bdcf-7ac3cbddbc82]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db471760-8c5e-4127-9c5c-bd8d68d0d5ab]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49113c1-e648-4f59-af14-d4d00baf30a0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4305d0-3c84-43f2-911d-c782b104ca95]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260]
Nov 29 23:19:15 user nova-compute[75244]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78, portal: 172.16.0.220,3260] successful.
Nov 29 23:19:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603f1eee-a1ea-4d77-aa4c-f52d63bf0d78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a708d-2909-42cc-9b0b-20fea0e44039]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] <== disconnect_volume: return (312ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:19:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'flavor' on Instance uuid 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:19:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ca46511f-4c2d-4969-b908-0626febd10a4 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:19:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:19:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:19:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:19:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:19:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:19:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:19:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:19:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:19:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:19:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8066MB free_disk=24.944961547851562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 434a4b52-a73d-47f7-938a-c7b30dcfc35f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:19:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:19:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:19:50 user nova-compute[75244]: INFO nova.compute.manager [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] instance snapshotting
Nov 29 23:19:50 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Beginning live snapshot process
Nov 29 23:19:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json -f qcow2 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6y1xgkmh/8f8f9e57a26d4244b05343b0419acafb.delta 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6y1xgkmh/8f8f9e57a26d4244b05343b0419acafb.delta 1073741824" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:51 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 23:19:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:19:52 user nova-compute[75244]: INFO nova.compute.manager [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Detaching volume 4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:19:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75244) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 23:19:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 23:19:52 user nova-compute[75244]: INFO nova.virt.block_device [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Attempting to driver detach volume 4e91b542-bf31-4de8-9f9e-81e46267182f from mountpoint /dev/vdb
Nov 29 23:19:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Attempting to detach device vdb from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:19:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:19:52 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:19:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:19:52 user nova-compute[75244]:   <serial>4e91b542-bf31-4de8-9f9e-81e46267182f</serial>
Nov 29 23:19:52 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:19:52 user nova-compute[75244]: </disk>
Nov 29 23:19:52 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:19:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully detached device vdb from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d from the persistent domain config.
Nov 29 23:19:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:19:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:19:52 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:19:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:19:52 user nova-compute[75244]:   <serial>4e91b542-bf31-4de8-9f9e-81e46267182f</serial>
Nov 29 23:19:52 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 23:19:52 user nova-compute[75244]: </disk>
Nov 29 23:19:52 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6y1xgkmh/8f8f9e57a26d4244b05343b0419acafb.delta /opt/stack/data/nova/instances/snapshots/tmp6y1xgkmh/8f8f9e57a26d4244b05343b0419acafb {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:19:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6y1xgkmh/8f8f9e57a26d4244b05343b0419acafb.delta /opt/stack/data/nova/instances/snapshots/tmp6y1xgkmh/8f8f9e57a26d4244b05343b0419acafb" returned: 0 in 0.722s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:19:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Snapshot extracted, beginning image upload
Nov 29 23:19:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:19:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Snapshot image upload complete
Nov 29 23:19:55 user nova-compute[75244]: INFO nova.compute.manager [None req-e8312af2-99f7-4b44-8162-fc0dfe17d600 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Took 5.57 seconds to snapshot the instance on the hypervisor.
Nov 29 23:19:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:19:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:19:58 user nova-compute[75244]: INFO nova.compute.claims [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Claim successful on node user
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:19:58 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:19:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:19:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG nova.policy [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52463fb99804a39a7400dd0a62bc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8586834ec2a40eea6c8ee777319d909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:19:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Creating image(s)
Nov 29 23:19:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "/opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "/opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "4308f91faed242d2a2d21c2d021daad6c75e7dd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:19:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "4308f91faed242d2a2d21c2d021daad6c75e7dd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Successfully created port: 75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:20:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:00 user nova-compute[75244]: DEBUG nova.virt.images [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] a469c5db-8b34-49fc-b83b-c13942c56f2e was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:20:00 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:20:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.part /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.part /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.converted" returned: 0 in 0.803s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "4308f91faed242d2a2d21c2d021daad6c75e7dd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.339s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Successfully updated port: 75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquired lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-changed-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Refreshing instance network info cache due to event network-changed-75cde73a-80eb-4416-9936-8edbdb42611d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] Acquiring lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "4308f91faed242d2a2d21c2d021daad6c75e7dd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "4308f91faed242d2a2d21c2d021daad6c75e7dd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8,backing_fmt=raw /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8,backing_fmt=raw /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk 1073741824" returned: 0 in 0.052s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "4308f91faed242d2a2d21c2d021daad6c75e7dd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:01 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updating instance_info_cache with network_info: [{"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Releasing lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Instance network_info: |[{"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] Acquired lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Refreshing network info cache for port 75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Ensure instance console log exists: /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Start _get_guest_xml network_info=[{"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4ecb81756994aaa2128c1b3ce79f8536',container_format='bare',created_at=2023-11-29T23:19:50Z,direct_url=<?>,disk_format='qcow2',id=a469c5db-8b34-49fc-b83b-c13942c56f2e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1254474590',owner='c8586834ec2a40eea6c8ee777319d909',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T23:19:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'a469c5db-8b34-49fc-b83b-c13942c56f2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:20:02 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:02 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4ecb81756994aaa2128c1b3ce79f8536',container_format='bare',created_at=2023-11-29T23:19:50Z,direct_url=<?>,disk_format='qcow2',id=a469c5db-8b34-49fc-b83b-c13942c56f2e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1254474590',owner='c8586834ec2a40eea6c8ee777319d909',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T23:19:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-122740334',display_name='tempest-TestStampPattern-server-122740334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-122740334',id=35,image_ref='a469c5db-8b34-49fc-b83b-c13942c56f2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxte1rpyd5jQaGmUdfHPyQkG0c+iZHTywDrmc5m23eGK8tv2O5fUwNn4LhRvmXk79qHy4OuFi7LT7wqD0Kzwx6FDf7BPhKuTYVdjZFWcl01pmaKjbzmxpXWb8uFBV71Gw==',key_name='tempest-TestStampPattern-1844974625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8586834ec2a40eea6c8ee777319d909',ramdisk_id='',reservation_id='r-5bwb3ls2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7077e5ec-3f09-45f9-a011-d89eaf58d888',image_min_disk='1',image_min_ram='0',image_owner_id='c8586834ec2a40eea6c8ee777319d909',image_owner_project_name='tempest-TestStampPattern-1117540779',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1117540779-project-member',image_user_id='d52463fb99804a39a7400dd0a62bc7a0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1117540779',owner_user_name='tempest-TestStampPattern-1117540779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:19:59Z,user_data=None,user_id='d52463fb99804a39a7400dd0a62bc7a0',uuid=3c65059e-3b99-4199-8173-e334f87cb932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converting VIF {"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.objects.instance [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c65059e-3b99-4199-8173-e334f87cb932 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:20:02 user nova-compute[75244]:   <uuid>3c65059e-3b99-4199-8173-e334f87cb932</uuid>
Nov 29 23:20:02 user nova-compute[75244]:   <name>instance-00000023</name>
Nov 29 23:20:02 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:20:02 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:20:02 user nova-compute[75244]:   <metadata>
Nov 29 23:20:02 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:20:02 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:20:02 user nova-compute[75244]:       <nova:name>tempest-TestStampPattern-server-122740334</nova:name>
Nov 29 23:20:02 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:20:02</nova:creationTime>
Nov 29 23:20:02 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:20:02 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:20:02 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:20:02 user nova-compute[75244]:       <nova:owner>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:user uuid="d52463fb99804a39a7400dd0a62bc7a0">tempest-TestStampPattern-1117540779-project-member</nova:user>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:project uuid="c8586834ec2a40eea6c8ee777319d909">tempest-TestStampPattern-1117540779</nova:project>
Nov 29 23:20:02 user nova-compute[75244]:       </nova:owner>
Nov 29 23:20:02 user nova-compute[75244]:       <nova:root type="image" uuid="a469c5db-8b34-49fc-b83b-c13942c56f2e"/>
Nov 29 23:20:02 user nova-compute[75244]:       <nova:ports>
Nov 29 23:20:02 user nova-compute[75244]:         <nova:port uuid="75cde73a-80eb-4416-9936-8edbdb42611d">
Nov 29 23:20:02 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 23:20:02 user nova-compute[75244]:         </nova:port>
Nov 29 23:20:02 user nova-compute[75244]:       </nova:ports>
Nov 29 23:20:02 user nova-compute[75244]:     </nova:instance>
Nov 29 23:20:02 user nova-compute[75244]:   </metadata>
Nov 29 23:20:02 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:20:02 user nova-compute[75244]:     <system>
Nov 29 23:20:02 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:20:02 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:20:02 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:20:02 user nova-compute[75244]:       <entry name="serial">3c65059e-3b99-4199-8173-e334f87cb932</entry>
Nov 29 23:20:02 user nova-compute[75244]:       <entry name="uuid">3c65059e-3b99-4199-8173-e334f87cb932</entry>
Nov 29 23:20:02 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:20:02 user nova-compute[75244]:     </system>
Nov 29 23:20:02 user nova-compute[75244]:   </sysinfo>
Nov 29 23:20:02 user nova-compute[75244]:   <os>
Nov 29 23:20:02 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:20:02 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:20:02 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:20:02 user nova-compute[75244]:   </os>
Nov 29 23:20:02 user nova-compute[75244]:   <features>
Nov 29 23:20:02 user nova-compute[75244]:     <acpi/>
Nov 29 23:20:02 user nova-compute[75244]:     <apic/>
Nov 29 23:20:02 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:20:02 user nova-compute[75244]:   </features>
Nov 29 23:20:02 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:20:02 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:20:02 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:20:02 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:20:02 user nova-compute[75244]:   </clock>
Nov 29 23:20:02 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:20:02 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:20:02 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:20:02 user nova-compute[75244]:   </cpu>
Nov 29 23:20:02 user nova-compute[75244]:   <devices>
Nov 29 23:20:02 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:20:02 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:20:02 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk"/>
Nov 29 23:20:02 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:20:02 user nova-compute[75244]:     </disk>
Nov 29 23:20:02 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:20:02 user nova-compute[75244]:       <mac address="fa:16:3e:5d:22:8d"/>
Nov 29 23:20:02 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:02 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:20:02 user nova-compute[75244]:       <target dev="tap75cde73a-80"/>
Nov 29 23:20:02 user nova-compute[75244]:     </interface>
Nov 29 23:20:02 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:20:02 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/console.log" append="off"/>
Nov 29 23:20:02 user nova-compute[75244]:     </serial>
Nov 29 23:20:02 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:20:02 user nova-compute[75244]:     <video>
Nov 29 23:20:02 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:02 user nova-compute[75244]:     </video>
Nov 29 23:20:02 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:20:02 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:20:02 user nova-compute[75244]:     </rng>
Nov 29 23:20:02 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:20:02 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:20:02 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:20:02 user nova-compute[75244]:     </memballoon>
Nov 29 23:20:02 user nova-compute[75244]:   </devices>
Nov 29 23:20:02 user nova-compute[75244]: </domain>
Nov 29 23:20:02 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-122740334',display_name='tempest-TestStampPattern-server-122740334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-122740334',id=35,image_ref='a469c5db-8b34-49fc-b83b-c13942c56f2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxte1rpyd5jQaGmUdfHPyQkG0c+iZHTywDrmc5m23eGK8tv2O5fUwNn4LhRvmXk79qHy4OuFi7LT7wqD0Kzwx6FDf7BPhKuTYVdjZFWcl01pmaKjbzmxpXWb8uFBV71Gw==',key_name='tempest-TestStampPattern-1844974625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8586834ec2a40eea6c8ee777319d909',ramdisk_id='',reservation_id='r-5bwb3ls2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7077e5ec-3f09-45f9-a011-d89eaf58d888',image_min_disk='1',image_min_ram='0',image_owner_id='c8586834ec2a40eea6c8ee777319d909',image_owner_project_name='tempest-TestStampPattern-1117540779',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1117540779-project-member',image_user_id='d52463fb99804a39a7400dd0a62bc7a0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1117540779',owner_user_name='tempest-TestStampPattern-1117540779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:19:59Z,user_data=None,user_id='d52463fb99804a39a7400dd0a62bc7a0',uuid=3c65059e-3b99-4199-8173-e334f87cb932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converting VIF {"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG os_vif [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b607785b-63d2-59ad-bbc4-f01375123dd1', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75cde73a-80, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75cde73a-80, col_values=(('qos', UUID('11931dc1-5b0f-4210-b4e4-98c322ab3faa')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75cde73a-80, col_values=(('external_ids', {'iface-id': '75cde73a-80eb-4416-9936-8edbdb42611d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:22:8d', 'vm-uuid': '3c65059e-3b99-4199-8173-e334f87cb932'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:02 user nova-compute[75244]: INFO os_vif [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80')
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No VIF found with MAC fa:16:3e:5d:22:8d, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updated VIF entry in instance network info cache for port 75cde73a-80eb-4416-9936-8edbdb42611d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG nova.network.neutron [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updating instance_info_cache with network_info: [{"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-74dc743d-7e9b-45bb-83d5-84c48686cf75 req-fe1a81e9-56f7-46af-9736-04874151fa27 service nova] Releasing lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-3ad919eb-b51c-439f-9b7f-01ba3d4778a7 req-68955a59-b82d-4d7c-b7b8-53a55a972e2a service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3ad919eb-b51c-439f-9b7f-01ba3d4778a7 req-68955a59-b82d-4d7c-b7b8-53a55a972e2a service nova] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3ad919eb-b51c-439f-9b7f-01ba3d4778a7 req-68955a59-b82d-4d7c-b7b8-53a55a972e2a service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3ad919eb-b51c-439f-9b7f-01ba3d4778a7 req-68955a59-b82d-4d7c-b7b8-53a55a972e2a service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-3ad919eb-b51c-439f-9b7f-01ba3d4778a7 req-68955a59-b82d-4d7c-b7b8-53a55a972e2a service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] No waiting events found dispatching network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:03 user nova-compute[75244]: WARNING nova.compute.manager [req-3ad919eb-b51c-439f-9b7f-01ba3d4778a7 req-68955a59-b82d-4d7c-b7b8-53a55a972e2a service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received unexpected event network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d for instance with vm_state building and task_state spawning.
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:20:05 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Instance spawned successfully.
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:05 user nova-compute[75244]: INFO nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-0e7399f1-05be-4856-b821-b03543ff4afc req-c4f9d9d4-89ed-4cbb-b6be-10b9828048b6 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0e7399f1-05be-4856-b821-b03543ff4afc req-c4f9d9d4-89ed-4cbb-b6be-10b9828048b6 service nova] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0e7399f1-05be-4856-b821-b03543ff4afc req-c4f9d9d4-89ed-4cbb-b6be-10b9828048b6 service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0e7399f1-05be-4856-b821-b03543ff4afc req-c4f9d9d4-89ed-4cbb-b6be-10b9828048b6 service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-0e7399f1-05be-4856-b821-b03543ff4afc req-c4f9d9d4-89ed-4cbb-b6be-10b9828048b6 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] No waiting events found dispatching network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:05 user nova-compute[75244]: WARNING nova.compute.manager [req-0e7399f1-05be-4856-b821-b03543ff4afc req-c4f9d9d4-89ed-4cbb-b6be-10b9828048b6 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received unexpected event network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d for instance with vm_state building and task_state spawning.
Nov 29 23:20:06 user nova-compute[75244]: INFO nova.compute.manager [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Took 7.68 seconds to build instance.
Nov 29 23:20:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84adeec0-d44d-4100-826b-e44e836cdb51 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.800s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:09 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:20:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:20:09 user nova-compute[75244]: INFO nova.compute.claims [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Claim successful on node user
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.network.neutron [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:20:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.policy [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ea84d8bd20544ce86605bcf4b735838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6aaff9d03b4cbba8dd791fdd1c9592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:20:10 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Creating image(s)
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "/opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "/opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "/opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.219s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk 1073741824" returned: 0 in 0.052s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:10 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Successfully created port: 222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Cannot resize image /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Ensure instance console log exists: /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Successfully updated port: 222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "refresh_cache-f071bd0f-4c00-4230-89f5-31bb4ef16b59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquired lock "refresh_cache-f071bd0f-4c00-4230-89f5-31bb4ef16b59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-changed-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Refreshing instance network info cache due to event network-changed-222a8eb2-6fda-4b46-87d9-537077439138. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] Acquiring lock "refresh_cache-f071bd0f-4c00-4230-89f5-31bb4ef16b59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Updating instance_info_cache with network_info: [{"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Releasing lock "refresh_cache-f071bd0f-4c00-4230-89f5-31bb4ef16b59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Instance network_info: |[{"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] Acquired lock "refresh_cache-f071bd0f-4c00-4230-89f5-31bb4ef16b59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Refreshing network info cache for port 222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Start _get_guest_xml network_info=[{"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:20:12 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:12 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-495674906',display_name='tempest-VolumesNegativeTest-instance-495674906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-495674906',id=36,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c6aaff9d03b4cbba8dd791fdd1c9592',ramdisk_id='',reservation_id='r-etuyvhhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-834267857',owner_user_name='tempest-VolumesNegativeTest-834267857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:20:10Z,user_data=None,user_id='0ea84d8bd20544ce86605bcf4b735838',uuid=f071bd0f-4c00-4230-89f5-31bb4ef16b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Converting VIF {"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.objects.instance [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lazy-loading 'pci_devices' on Instance uuid f071bd0f-4c00-4230-89f5-31bb4ef16b59 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:20:12 user nova-compute[75244]:   <uuid>f071bd0f-4c00-4230-89f5-31bb4ef16b59</uuid>
Nov 29 23:20:12 user nova-compute[75244]:   <name>instance-00000024</name>
Nov 29 23:20:12 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:20:12 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:20:12 user nova-compute[75244]:   <metadata>
Nov 29 23:20:12 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:20:12 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:20:12 user nova-compute[75244]:       <nova:name>tempest-VolumesNegativeTest-instance-495674906</nova:name>
Nov 29 23:20:12 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:20:12</nova:creationTime>
Nov 29 23:20:12 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:20:12 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:20:12 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:20:12 user nova-compute[75244]:       <nova:owner>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:user uuid="0ea84d8bd20544ce86605bcf4b735838">tempest-VolumesNegativeTest-834267857-project-member</nova:user>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:project uuid="2c6aaff9d03b4cbba8dd791fdd1c9592">tempest-VolumesNegativeTest-834267857</nova:project>
Nov 29 23:20:12 user nova-compute[75244]:       </nova:owner>
Nov 29 23:20:12 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:20:12 user nova-compute[75244]:       <nova:ports>
Nov 29 23:20:12 user nova-compute[75244]:         <nova:port uuid="222a8eb2-6fda-4b46-87d9-537077439138">
Nov 29 23:20:12 user nova-compute[75244]:           <nova:ip type="fixed" address="192.168.233.235" ipVersion="4"/>
Nov 29 23:20:12 user nova-compute[75244]:         </nova:port>
Nov 29 23:20:12 user nova-compute[75244]:       </nova:ports>
Nov 29 23:20:12 user nova-compute[75244]:     </nova:instance>
Nov 29 23:20:12 user nova-compute[75244]:   </metadata>
Nov 29 23:20:12 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:20:12 user nova-compute[75244]:     <system>
Nov 29 23:20:12 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:20:12 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:20:12 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:20:12 user nova-compute[75244]:       <entry name="serial">f071bd0f-4c00-4230-89f5-31bb4ef16b59</entry>
Nov 29 23:20:12 user nova-compute[75244]:       <entry name="uuid">f071bd0f-4c00-4230-89f5-31bb4ef16b59</entry>
Nov 29 23:20:12 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:20:12 user nova-compute[75244]:     </system>
Nov 29 23:20:12 user nova-compute[75244]:   </sysinfo>
Nov 29 23:20:12 user nova-compute[75244]:   <os>
Nov 29 23:20:12 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:20:12 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:20:12 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:20:12 user nova-compute[75244]:   </os>
Nov 29 23:20:12 user nova-compute[75244]:   <features>
Nov 29 23:20:12 user nova-compute[75244]:     <acpi/>
Nov 29 23:20:12 user nova-compute[75244]:     <apic/>
Nov 29 23:20:12 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:20:12 user nova-compute[75244]:   </features>
Nov 29 23:20:12 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:20:12 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:20:12 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:20:12 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:20:12 user nova-compute[75244]:   </clock>
Nov 29 23:20:12 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:20:12 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:20:12 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:20:12 user nova-compute[75244]:   </cpu>
Nov 29 23:20:12 user nova-compute[75244]:   <devices>
Nov 29 23:20:12 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:20:12 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:20:12 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk"/>
Nov 29 23:20:12 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:20:12 user nova-compute[75244]:     </disk>
Nov 29 23:20:12 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:20:12 user nova-compute[75244]:       <mac address="fa:16:3e:c2:11:d6"/>
Nov 29 23:20:12 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:12 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:20:12 user nova-compute[75244]:       <target dev="tap222a8eb2-6f"/>
Nov 29 23:20:12 user nova-compute[75244]:     </interface>
Nov 29 23:20:12 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:20:12 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/console.log" append="off"/>
Nov 29 23:20:12 user nova-compute[75244]:     </serial>
Nov 29 23:20:12 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:20:12 user nova-compute[75244]:     <video>
Nov 29 23:20:12 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:12 user nova-compute[75244]:     </video>
Nov 29 23:20:12 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:20:12 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:20:12 user nova-compute[75244]:     </rng>
Nov 29 23:20:12 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:20:12 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:20:12 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:20:12 user nova-compute[75244]:     </memballoon>
Nov 29 23:20:12 user nova-compute[75244]:   </devices>
Nov 29 23:20:12 user nova-compute[75244]: </domain>
Nov 29 23:20:12 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-495674906',display_name='tempest-VolumesNegativeTest-instance-495674906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-495674906',id=36,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c6aaff9d03b4cbba8dd791fdd1c9592',ramdisk_id='',reservation_id='r-etuyvhhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-834267857',owner_user_name='tempest-VolumesNegativeTest-834267857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:20:10Z,user_data=None,user_id='0ea84d8bd20544ce86605bcf4b735838',uuid=f071bd0f-4c00-4230-89f5-31bb4ef16b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Converting VIF {"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG os_vif [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9b97d0f-4aaf-5c19-b4c7-d0c4ad0d5b64', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap222a8eb2-6f, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap222a8eb2-6f, col_values=(('qos', UUID('1d8176b8-893a-4367-a6dd-ae56b0f2ffed')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap222a8eb2-6f, col_values=(('external_ids', {'iface-id': '222a8eb2-6fda-4b46-87d9-537077439138', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:11:d6', 'vm-uuid': 'f071bd0f-4c00-4230-89f5-31bb4ef16b59'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:12 user nova-compute[75244]: INFO os_vif [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f')
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] No VIF found with MAC fa:16:3e:c2:11:d6, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Updated VIF entry in instance network info cache for port 222a8eb2-6fda-4b46-87d9-537077439138. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG nova.network.neutron [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Updating instance_info_cache with network_info: [{"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ff5abc5d-66cd-49b5-90da-28ff38ca8957 req-cd1c67a8-71b7-4c07-b05d-2b2fa7010aa8 service nova] Releasing lock "refresh_cache-f071bd0f-4c00-4230-89f5-31bb4ef16b59" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d is timed out.
Nov 29 23:20:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully detached device vdb from instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d from the live domain config.
Nov 29 23:20:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTMKIZBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:20:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc8184-1ccb-4c58-9735-c0807cfb9e88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:20:13 user nova-compute[75244]: No targets found.
Nov 29 23:20:13 user nova-compute[75244]: iSNS:
Nov 29 23:20:13 user nova-compute[75244]: No targets found.
Nov 29 23:20:13 user nova-compute[75244]: STATIC:
Nov 29 23:20:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:20:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:20:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:20:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f
Nov 29 23:20:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:20:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:20:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:20:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:20:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:20:13 user nova-compute[75244]: FIRMWARE:
Nov 29 23:20:13 user nova-compute[75244]: No targets found.
Nov 29 23:20:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:20:13 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:20:13 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[232a636c-2ba0-4ad8-a90d-44dbfb8dd6e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4ad960-4b66-4dfb-b63a-41a38997f471]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:20:13 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:20:13 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:20:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:20:13 user nova-compute[75244]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f (non-flash)
Nov 29 23:20:13 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:20:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804212b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c10774-9d05-4430-8865-6dccf9aae64f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa7ed1-49eb-43ec-8cf7-cc3de18401d4]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528d1fd-1eca-4959-9390-1c306ad9de5d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9721b3-8d84-4885-b390-7112282f7e0b]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6fc11-5e1c-439b-a86b-aa70b012a961]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede2366-0aee-4fc9-9868-1bbc3c131bed]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260]
Nov 29 23:20:13 user nova-compute[75244]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f, portal: 172.16.0.220,3260] successful.
Nov 29 23:20:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e91b542-bf31-4de8-9f9e-81e46267182f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde188b0-87ee-4aad-9f05-092444715ffc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== disconnect_volume: return (308ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:20:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'flavor' on Instance uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-a7feaecc-1053-4c00-baa3-e8ce903e1ca4 req-b4b7ba11-7a00-4490-ba94-c0ed723f65ef service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a7feaecc-1053-4c00-baa3-e8ce903e1ca4 req-b4b7ba11-7a00-4490-ba94-c0ed723f65ef service nova] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a7feaecc-1053-4c00-baa3-e8ce903e1ca4 req-b4b7ba11-7a00-4490-ba94-c0ed723f65ef service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a7feaecc-1053-4c00-baa3-e8ce903e1ca4 req-b4b7ba11-7a00-4490-ba94-c0ed723f65ef service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-a7feaecc-1053-4c00-baa3-e8ce903e1ca4 req-b4b7ba11-7a00-4490-ba94-c0ed723f65ef service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] No waiting events found dispatching network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:14 user nova-compute[75244]: WARNING nova.compute.manager [req-a7feaecc-1053-4c00-baa3-e8ce903e1ca4 req-b4b7ba11-7a00-4490-ba94-c0ed723f65ef service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received unexpected event network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 for instance with vm_state building and task_state spawning.
Nov 29 23:20:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3c9b98-508c-4f82-a0e9-066b79d58281 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.087s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:20:16 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Instance spawned successfully.
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-c1c45619-d48c-44aa-ac4b-7a1a85e5be00 req-1403ffea-d586-4233-8dd0-49cb1a7fb8d0 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c1c45619-d48c-44aa-ac4b-7a1a85e5be00 req-1403ffea-d586-4233-8dd0-49cb1a7fb8d0 service nova] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c1c45619-d48c-44aa-ac4b-7a1a85e5be00 req-1403ffea-d586-4233-8dd0-49cb1a7fb8d0 service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c1c45619-d48c-44aa-ac4b-7a1a85e5be00 req-1403ffea-d586-4233-8dd0-49cb1a7fb8d0 service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-c1c45619-d48c-44aa-ac4b-7a1a85e5be00 req-1403ffea-d586-4233-8dd0-49cb1a7fb8d0 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] No waiting events found dispatching network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:16 user nova-compute[75244]: WARNING nova.compute.manager [req-c1c45619-d48c-44aa-ac4b-7a1a85e5be00 req-1403ffea-d586-4233-8dd0-49cb1a7fb8d0 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received unexpected event network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 for instance with vm_state building and task_state spawning.
Nov 29 23:20:16 user nova-compute[75244]: INFO nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 29 23:20:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:20:16 user nova-compute[75244]: INFO nova.compute.manager [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Took 7.00 seconds to build instance.
Nov 29 23:20:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-60cfc932-9574-429b-ac8e-00fe8225a5b5 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.197s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:19 user nova-compute[75244]: INFO nova.compute.manager [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Rescuing
Nov 29 23:20:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating instance_info_cache with network_info: [{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-88182ef8-b64f-459a-8644-48b461dfc865 req-bab1cda7-45ac-4b34-a762-ffeaa1096364 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-88182ef8-b64f-459a-8644-48b461dfc865 req-bab1cda7-45ac-4b34-a762-ffeaa1096364 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-88182ef8-b64f-459a-8644-48b461dfc865 req-bab1cda7-45ac-4b34-a762-ffeaa1096364 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-88182ef8-b64f-459a-8644-48b461dfc865 req-bab1cda7-45ac-4b34-a762-ffeaa1096364 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-88182ef8-b64f-459a-8644-48b461dfc865 req-bab1cda7-45ac-4b34-a762-ffeaa1096364 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:20 user nova-compute[75244]: WARNING nova.compute.manager [req-88182ef8-b64f-459a-8644-48b461dfc865 req-bab1cda7-45ac-4b34-a762-ffeaa1096364 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state rescuing.
Nov 29 23:20:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:21 user nova-compute[75244]: INFO nova.compute.manager [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Terminating instance
Nov 29 23:20:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:20:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance destroyed successfully.
Nov 29 23:20:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Attempting a stable device rescue
Nov 29 23:20:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75244) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:20:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Creating image(s)
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "/opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "/opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.part --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-47bcfd02-8571-44ae-b970-7b58a1849100 req-1b286395-c631-4866-ba46-ab279f9b836a service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-vif-unplugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-47bcfd02-8571-44ae-b970-7b58a1849100 req-1b286395-c631-4866-ba46-ab279f9b836a service nova] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-47bcfd02-8571-44ae-b970-7b58a1849100 req-1b286395-c631-4866-ba46-ab279f9b836a service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-47bcfd02-8571-44ae-b970-7b58a1849100 req-1b286395-c631-4866-ba46-ab279f9b836a service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-47bcfd02-8571-44ae-b970-7b58a1849100 req-1b286395-c631-4866-ba46-ab279f9b836a service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] No waiting events found dispatching network-vif-unplugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-47bcfd02-8571-44ae-b970-7b58a1849100 req-1b286395-c631-4866-ba46-ab279f9b836a service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-vif-unplugged-4485cd57-2365-497e-bb88-d5eb518748bc for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:20:22 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Instance destroyed successfully.
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lazy-loading 'resources' on Instance uuid 434a4b52-a73d-47f7-938a-c7b30dcfc35f {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1806778782',display_name='tempest-VolumesActionsTest-instance-1806778782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1806778782',id=33,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:18:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf62fb1d72164f4883c82ccf7d601833',ramdisk_id='',reservation_id='r-a95b1mil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1332048055',owner_user_name='tempest-VolumesActionsTest-1332048055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:18:29Z,user_data=None,user_id='95d9846a47564c9caced77975fbd9ebc',uuid=434a4b52-a73d-47f7-938a-c7b30dcfc35f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Converting VIF {"id": "4485cd57-2365-497e-bb88-d5eb518748bc", "address": "fa:16:3e:e2:2d:73", "network": {"id": "bdcc9ca5-c8a0-49de-aa01-38179f0a89d4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1888807756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf62fb1d72164f4883c82ccf7d601833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4485cd57-23", "ovs_interfaceid": "4485cd57-2365-497e-bb88-d5eb518748bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG os_vif [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4485cd57-23, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cb5106a-44ea-4e51-ac1f-bc434948b331) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:23 user nova-compute[75244]: INFO os_vif [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2d:73,bridge_name='br-int',has_traffic_filtering=True,id=4485cd57-2365-497e-bb88-d5eb518748bc,network=Network(bdcc9ca5-c8a0-49de-aa01-38179f0a89d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4485cd57-23')
Nov 29 23:20:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Deleting instance files /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f_del
Nov 29 23:20:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Deletion of /opt/stack/data/nova/instances/434a4b52-a73d-47f7-938a-c7b30dcfc35f_del complete
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-079b8f39-9d8d-49b4-8815-198a2cc6f674 req-3975f223-851d-4466-a4d5-55164762bfbf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-079b8f39-9d8d-49b4-8815-198a2cc6f674 req-3975f223-851d-4466-a4d5-55164762bfbf service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-079b8f39-9d8d-49b4-8815-198a2cc6f674 req-3975f223-851d-4466-a4d5-55164762bfbf service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-079b8f39-9d8d-49b4-8815-198a2cc6f674 req-3975f223-851d-4466-a4d5-55164762bfbf service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-079b8f39-9d8d-49b4-8815-198a2cc6f674 req-3975f223-851d-4466-a4d5-55164762bfbf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:23 user nova-compute[75244]: WARNING nova.compute.manager [req-079b8f39-9d8d-49b4-8815-198a2cc6f674 req-3975f223-851d-4466-a4d5-55164762bfbf service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state rescuing.
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.images [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] 3be27e8c-6aec-4905-9950-774a018c33a4 was qcow2, converting to raw {{(pid=75244) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.privsep.utils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75244) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.part /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.converted {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:23 user nova-compute[75244]: INFO nova.compute.manager [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.part /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.converted" returned: 0 in 0.284s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.converted --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.870s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:23 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Took 0.51 seconds to deallocate network for instance.
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e,backing_fmt=raw /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e,backing_fmt=raw /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue" returned: 0 in 0.071s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'migration_context' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<34c3ab5b-1a14-4756-8909-3b0c66b6a8b4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Start _get_guest_xml network_info=[{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "vif_mac": "fa:16:3e:94:6c:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3be27e8c-6aec-4905-9950-774a018c33a4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '34c3ab5b-1a14-4756-8909-3b0c66b6a8b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'serial': 'ecdf8c9d-af01-46a4-b6f7-cf825a706793'}, 'attachment_id': '0231b3ab-bcfa-4833-bdce-903a1404285c', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'resources' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<34c3ab5b-1a14-4756-8909-3b0c66b6a8b4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'numa_topology' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<34c3ab5b-1a14-4756-8909-3b0c66b6a8b4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:20:23 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:23 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.objects.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<34c3ab5b-1a14-4756-8909-3b0c66b6a8b4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:20:23 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:20:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:20:23 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:20:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:20:23 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] Acquiring lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] No waiting events found dispatching network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:23 user nova-compute[75244]: WARNING nova.compute.manager [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received unexpected event network-vif-plugged-4485cd57-2365-497e-bb88-d5eb518748bc for instance with vm_state deleted and task_state None.
Nov 29 23:20:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-98287853-2616-4c39-8ba9-e648958269e0 req-13ca61cc-d9f1-412c-a64c-4688510622fe service nova] [instance: 434a4b52-a73d-47f7-938a-c7b30dcfc35f] Received event network-vif-deleted-4485cd57-2365-497e-bb88-d5eb518748bc {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23402935-03d6-4cd8-a2e3-02a5fa299e13]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UuGSFOcs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 23:20:24 user nova-compute[75244]: node.name = iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:20:24 user nova-compute[75244]: node.tpgt = -1
Nov 29 23:20:24 user nova-compute[75244]: node.startup = automatic
Nov 29 23:20:24 user nova-compute[75244]: node.leading_login = No
Nov 29 23:20:24 user nova-compute[75244]: iface.iscsi_ifacename = default
Nov 29 23:20:24 user nova-compute[75244]: iface.net_ifacename = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.ipaddress = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.prefix_len = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.hwaddress = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.transport_name = tcp
Nov 29 23:20:24 user nova-compute[75244]: iface.initiatorname = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.vlan_id = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.vlan_priority = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.vlan_state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.iface_num = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.mtu = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.port = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.bootproto = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.subnet_mask = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.gateway = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_alt_client_id = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_dns = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_learn_iqn = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_vendor_id_state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_vendor_id = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.dhcp_slp_da = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.fragmentation = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.gratuitous_arp = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.incoming_forwarding = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.tos_state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.tos = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.ttl = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.delayed_ack = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.tcp_nagle = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.tcp_wsf_state = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.tcp_wsf = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.tcp_timer_scale = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.tcp_timestamp = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.redirect = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.def_task_mgmt_timeout = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.header_digest = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.data_digest = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.immediate_data = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.initial_r2t = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.data_seq_inorder = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.data_pdu_inorder = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.erl = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.max_receive_data_len = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.first_burst_len = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.max_outstanding_r2t = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.max_burst_len = 0
Nov 29 23:20:24 user nova-compute[75244]: iface.chap_auth = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.bidi_chap = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.strict_login_compliance = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.discovery_auth = <empty>
Nov 29 23:20:24 user nova-compute[75244]: iface.discovery_logout = <empty>
Nov 29 23:20:24 user nova-compute[75244]: node.discovery_address = <empty>
Nov 29 23:20:24 user nova-compute[75244]: node.discovery_port = 0
Nov 29 23:20:24 user nova-compute[75244]: node.discovery_type = static
Nov 29 23:20:24 user nova-compute[75244]: node.session.initial_cmdsn = 0
Nov 29 23:20:24 user nova-compute[75244]: node.session.initial_login_retry_max = 8
Nov 29 23:20:24 user nova-compute[75244]: node.session.xmit_thread_priority = -20
Nov 29 23:20:24 user nova-compute[75244]: node.session.cmds_max = 128
Nov 29 23:20:24 user nova-compute[75244]: node.session.queue_depth = 32
Nov 29 23:20:24 user nova-compute[75244]: node.session.nr_sessions = 1
Nov 29 23:20:24 user nova-compute[75244]: node.session.auth.authmethod = CHAP
Nov 29 23:20:24 user nova-compute[75244]: node.session.auth.username = UuGSFOcs
Nov 29 23:20:24 user nova-compute[75244]: node.session.auth.password = ***
Nov 29 23:20:24 user nova-compute[75244]: node.session.auth.username_in = <empty>
Nov 29 23:20:24 user nova-compute[75244]: node.session.auth.password_in = <empty>
Nov 29 23:20:24 user nova-compute[75244]: node.session.auth.chap_algs = MD5
Nov 29 23:20:24 user nova-compute[75244]: node.session.timeo.replacement_timeout = 120
Nov 29 23:20:24 user nova-compute[75244]: node.session.err_timeo.abort_timeout = 15
Nov 29 23:20:24 user nova-compute[75244]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 23:20:24 user nova-compute[75244]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 23:20:24 user nova-compute[75244]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.FastAbort = Yes
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.InitialR2T = No
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.ImmediateData = Yes
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.MaxConnections = 1
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 23:20:24 user nova-compute[75244]: node.session.iscsi.ERL = 0
Nov 29 23:20:24 user nova-compute[75244]: node.session.scan = manual
Nov 29 23:20:24 user nova-compute[75244]: node.session.reopen_max = 0
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].address = 172.16.0.220
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].port = 3260
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].startup = manual
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].tcp.window_size = 524288
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].tcp.type_of_service = 0
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].timeo.logout_timeout = 15
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].timeo.login_timeout = 15
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].timeo.auth_timeout = 45
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].iscsi.DataDigest = None
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].iscsi.IFMarker = No
Nov 29 23:20:24 user nova-compute[75244]: node.conn[0].iscsi.OFMarker = No
Nov 29 23:20:24 user nova-compute[75244]: # END RECORD
Nov 29 23:20:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b7d9de-ee17-4467-bd50-c72e98df61b6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d78a3-771f-4dbd-90b7-deecb522b9cc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuGSFOcs {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UuGSFOcs" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee96e0f2-1951-4b47-b81c-26d4fa6804ae]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UuGSFOcs'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2306d2-4718-4e3c-b5a9-4bc357282f1f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c214b38-5215-4041-85bd-edf25e7d28d5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:20:24 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:20:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:20:24 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:20:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] HCTL ('34', '0', '0', 0) found on session 43 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb63cd-1a9b-4488-ba12-0b379741ac65]: (4, ('0 0 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Searching for a device in session 43 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23663313163626137', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663313163626137', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:20:24 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Deleted allocations for instance 434a4b52-a73d-47f7-938a-c7b30dcfc35f
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1256519036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1256519036',id=34,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-7t6km07m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:18:49Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=34c3ab5b-1a14-4756-8909-3b0c66b6a8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "vif_mac": "fa:16:3e:94:6c:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "vif_mac": "fa:16:3e:94:6c:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'pci_devices' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.objects.base [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Object Instance<34c3ab5b-1a14-4756-8909-3b0c66b6a8b4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:20:24 user nova-compute[75244]:   <uuid>34c3ab5b-1a14-4756-8909-3b0c66b6a8b4</uuid>
Nov 29 23:20:24 user nova-compute[75244]:   <name>instance-00000022</name>
Nov 29 23:20:24 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:20:24 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:20:24 user nova-compute[75244]:   <metadata>
Nov 29 23:20:24 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:20:24 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:20:24 user nova-compute[75244]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1256519036</nova:name>
Nov 29 23:20:24 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:20:23</nova:creationTime>
Nov 29 23:20:24 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:20:24 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:20:24 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:20:24 user nova-compute[75244]:       <nova:owner>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:user uuid="c2a16d9d8a414de4b6621acd12b89aa0">tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member</nova:user>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:project uuid="9595b50731fc44ae85e99ded8dbbaf61">tempest-ServerBootFromVolumeStableRescueTest-1262475948</nova:project>
Nov 29 23:20:24 user nova-compute[75244]:       </nova:owner>
Nov 29 23:20:24 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:20:24 user nova-compute[75244]:       <nova:ports>
Nov 29 23:20:24 user nova-compute[75244]:         <nova:port uuid="602929c7-87cd-4cfe-9e23-ba81c6e54c26">
Nov 29 23:20:24 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 23:20:24 user nova-compute[75244]:         </nova:port>
Nov 29 23:20:24 user nova-compute[75244]:       </nova:ports>
Nov 29 23:20:24 user nova-compute[75244]:     </nova:instance>
Nov 29 23:20:24 user nova-compute[75244]:   </metadata>
Nov 29 23:20:24 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:20:24 user nova-compute[75244]:     <system>
Nov 29 23:20:24 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:20:24 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:20:24 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:20:24 user nova-compute[75244]:       <entry name="serial">34c3ab5b-1a14-4756-8909-3b0c66b6a8b4</entry>
Nov 29 23:20:24 user nova-compute[75244]:       <entry name="uuid">34c3ab5b-1a14-4756-8909-3b0c66b6a8b4</entry>
Nov 29 23:20:24 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:20:24 user nova-compute[75244]:     </system>
Nov 29 23:20:24 user nova-compute[75244]:   </sysinfo>
Nov 29 23:20:24 user nova-compute[75244]:   <os>
Nov 29 23:20:24 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:20:24 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:20:24 user nova-compute[75244]:   </os>
Nov 29 23:20:24 user nova-compute[75244]:   <features>
Nov 29 23:20:24 user nova-compute[75244]:     <acpi/>
Nov 29 23:20:24 user nova-compute[75244]:     <apic/>
Nov 29 23:20:24 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:20:24 user nova-compute[75244]:   </features>
Nov 29 23:20:24 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:20:24 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:20:24 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:20:24 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:20:24 user nova-compute[75244]:   </clock>
Nov 29 23:20:24 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:20:24 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:20:24 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:20:24 user nova-compute[75244]:   </cpu>
Nov 29 23:20:24 user nova-compute[75244]:   <devices>
Nov 29 23:20:24 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:20:24 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:20:24 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:20:24 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:20:24 user nova-compute[75244]:       <serial>ecdf8c9d-af01-46a4-b6f7-cf825a706793</serial>
Nov 29 23:20:24 user nova-compute[75244]:     </disk>
Nov 29 23:20:24 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:20:24 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:20:24 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue"/>
Nov 29 23:20:24 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:20:24 user nova-compute[75244]:       <boot order="1"/>
Nov 29 23:20:24 user nova-compute[75244]:     </disk>
Nov 29 23:20:24 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:20:24 user nova-compute[75244]:       <mac address="fa:16:3e:94:6c:41"/>
Nov 29 23:20:24 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:24 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:20:24 user nova-compute[75244]:       <target dev="tap602929c7-87"/>
Nov 29 23:20:24 user nova-compute[75244]:     </interface>
Nov 29 23:20:24 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:20:24 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/console.log" append="off"/>
Nov 29 23:20:24 user nova-compute[75244]:     </serial>
Nov 29 23:20:24 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:20:24 user nova-compute[75244]:     <video>
Nov 29 23:20:24 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:24 user nova-compute[75244]:     </video>
Nov 29 23:20:24 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:20:24 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:20:24 user nova-compute[75244]:     </rng>
Nov 29 23:20:24 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:20:24 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:20:24 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:20:24 user nova-compute[75244]:     </memballoon>
Nov 29 23:20:24 user nova-compute[75244]:   </devices>
Nov 29 23:20:24 user nova-compute[75244]: </domain>
Nov 29 23:20:24 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:20:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance destroyed successfully.
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] No VIF found with MAC fa:16:3e:94:6c:41, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:20:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6b1e7de1-ef81-4281-b452-5b4ef5491ce2 tempest-VolumesActionsTest-1332048055 tempest-VolumesActionsTest-1332048055-project-member] Lock "434a4b52-a73d-47f7-938a-c7b30dcfc35f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb8d639e-20d1-40f5-a60d-82af78c76367 req-610805fc-29d9-4dcb-87a4-ddd1e05fe0f7 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb8d639e-20d1-40f5-a60d-82af78c76367 req-610805fc-29d9-4dcb-87a4-ddd1e05fe0f7 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb8d639e-20d1-40f5-a60d-82af78c76367 req-610805fc-29d9-4dcb-87a4-ddd1e05fe0f7 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-eb8d639e-20d1-40f5-a60d-82af78c76367 req-610805fc-29d9-4dcb-87a4-ddd1e05fe0f7 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-eb8d639e-20d1-40f5-a60d-82af78c76367 req-610805fc-29d9-4dcb-87a4-ddd1e05fe0f7 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:25 user nova-compute[75244]: WARNING nova.compute.manager [req-eb8d639e-20d1-40f5-a60d-82af78c76367 req-610805fc-29d9-4dcb-87a4-ddd1e05fe0f7 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state rescuing.
Nov 29 23:20:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b927ee44-c2b6-4eaa-8700-0aee8e31ba84 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:20:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b33feb0e-1492-4706-9f60-002237a3745d req-077d7520-e5b6-47ab-99af-e12a230a79e6 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b33feb0e-1492-4706-9f60-002237a3745d req-077d7520-e5b6-47ab-99af-e12a230a79e6 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b33feb0e-1492-4706-9f60-002237a3745d req-077d7520-e5b6-47ab-99af-e12a230a79e6 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b33feb0e-1492-4706-9f60-002237a3745d req-077d7520-e5b6-47ab-99af-e12a230a79e6 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b33feb0e-1492-4706-9f60-002237a3745d req-077d7520-e5b6-47ab-99af-e12a230a79e6 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:28 user nova-compute[75244]: WARNING nova.compute.manager [req-b33feb0e-1492-4706-9f60-002237a3745d req-077d7520-e5b6-47ab-99af-e12a230a79e6 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state rescued and task_state None.
Nov 29 23:20:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:42 user nova-compute[75244]: INFO nova.compute.manager [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Terminating instance
Nov 29 23:20:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-ec900b74-60cb-4837-b0af-5f72757ed286 req-0ad56d1d-5510-40d3-be07-3a53a1ce3ad8 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-unplugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ec900b74-60cb-4837-b0af-5f72757ed286 req-0ad56d1d-5510-40d3-be07-3a53a1ce3ad8 service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ec900b74-60cb-4837-b0af-5f72757ed286 req-0ad56d1d-5510-40d3-be07-3a53a1ce3ad8 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ec900b74-60cb-4837-b0af-5f72757ed286 req-0ad56d1d-5510-40d3-be07-3a53a1ce3ad8 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-ec900b74-60cb-4837-b0af-5f72757ed286 req-0ad56d1d-5510-40d3-be07-3a53a1ce3ad8 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-unplugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-ec900b74-60cb-4837-b0af-5f72757ed286 req-0ad56d1d-5510-40d3-be07-3a53a1ce3ad8 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-unplugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.compute.claims [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Claim successful on node user
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Instance destroyed successfully.
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'resources' on Instance uuid 1bac525e-daeb-49d9-a4bc-96bf5bd2543d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T23:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1643090801',display_name='tempest-ServerActionsTestOtherA-server-1723557111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1643090801',id=29,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErh/VToo0qYK6+7fEb47QasHwkBDh/Di7DcZqgW5G5XcHJcicmvkwPEc73bpsWhk53vBOdaarefC0jqkVt2PY7VV6Oq48EkCO2rbi5COodppn+fElofB2+D+fgtpAooDw==',key_name='tempest-keypair-1881256599',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:17:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-6bytho4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1bac525e-daeb-49d9-a4bc-96bf5bd2543d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "address": "fa:16:3e:99:6a:7d", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap796f511a-90", "ovs_interfaceid": "796f511a-90e8-4b6f-8bc0-25ed0d7fff0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG os_vif [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap796f511a-90, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8de29f7-a78b-4588-9220-b01043dfeb39) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:43 user nova-compute[75244]: INFO os_vif [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:6a:7d,bridge_name='br-int',has_traffic_filtering=True,id=796f511a-90e8-4b6f-8bc0-25ed0d7fff0f,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap796f511a-90')
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Deleting instance files /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d_del
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Deletion of /opt/stack/data/nova/instances/1bac525e-daeb-49d9-a4bc-96bf5bd2543d_del complete
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.compute.manager [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.network.neutron [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:20:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Creating image(s)
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "/opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "/opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG nova.policy [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30e7929c023f45ffa625cc695e38435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908ee37c0ad54c3db82d31b804007bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk 1073741824" returned: 0 in 0.053s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Cannot resize image /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Ensure instance console log exists: /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:44 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Took 1.04 seconds to deallocate network for instance.
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-cf8e0f95-4128-4cc8-b845-04375429ecbe req-afa5048a-875d-429f-8569-feebbd1f1ce9 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-deleted-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.network.neutron [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Successfully created port: 80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:44 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [{"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-9cb9953c-e973-45b7-87d4-00a4f3e74a54" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:45 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Deleted allocations for instance 1bac525e-daeb-49d9-a4bc-96bf5bd2543d
Nov 29 23:20:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-94bd7ea7-e05e-4599-b02e-8807407c0924 req-526dc599-c281-4a05-8103-720b85e5d711 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-94bd7ea7-e05e-4599-b02e-8807407c0924 req-526dc599-c281-4a05-8103-720b85e5d711 service nova] Acquiring lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-94bd7ea7-e05e-4599-b02e-8807407c0924 req-526dc599-c281-4a05-8103-720b85e5d711 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-94bd7ea7-e05e-4599-b02e-8807407c0924 req-526dc599-c281-4a05-8103-720b85e5d711 service nova] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-94bd7ea7-e05e-4599-b02e-8807407c0924 req-526dc599-c281-4a05-8103-720b85e5d711 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] No waiting events found dispatching network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:45 user nova-compute[75244]: WARNING nova.compute.manager [req-94bd7ea7-e05e-4599-b02e-8807407c0924 req-526dc599-c281-4a05-8103-720b85e5d711 service nova] [instance: 1bac525e-daeb-49d9-a4bc-96bf5bd2543d] Received unexpected event network-vif-plugged-796f511a-90e8-4b6f-8bc0-25ed0d7fff0f for instance with vm_state deleted and task_state None.
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d730efb-313c-49f7-9bff-ca6cfc9e2956 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1bac525e-daeb-49d9-a4bc-96bf5bd2543d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Successfully updated port: 80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquired lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:20:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updating instance_info_cache with network_info: [{"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Releasing lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Instance network_info: |[{"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Start _get_guest_xml network_info=[{"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:20:46 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:46 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1793930855',display_name='tempest-VolumesSnapshotTestJSON-instance-1793930855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1793930855',id=37,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd/KA5j7++lFHJMDwNrhzCJmbJa0PV0psgU+HzMQltcY8uohIf4Z4Niq9/wZ1cZOUfI8XPruE7q3wc7dO4P9g6WqVSDMpjx2HT3snujOFVOyRWIvqgYsI/+4TCOMcsAWg==',key_name='tempest-keypair-1148333361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='908ee37c0ad54c3db82d31b804007bad',ramdisk_id='',reservation_id='r-arlfnqtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1543690330',owner_user_name='tempest-VolumesSnapshotTestJSON-1543690330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e7929c023f45ffa625cc695e38435d',uuid=bd19d775-ade7-4f61-a8f4-ce7f7316d30b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converting VIF {"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'pci_devices' on Instance uuid bd19d775-ade7-4f61-a8f4-ce7f7316d30b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:20:46 user nova-compute[75244]:   <uuid>bd19d775-ade7-4f61-a8f4-ce7f7316d30b</uuid>
Nov 29 23:20:46 user nova-compute[75244]:   <name>instance-00000025</name>
Nov 29 23:20:46 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:20:46 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:20:46 user nova-compute[75244]:   <metadata>
Nov 29 23:20:46 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:20:46 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:20:46 user nova-compute[75244]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1793930855</nova:name>
Nov 29 23:20:46 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:20:46</nova:creationTime>
Nov 29 23:20:46 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:20:46 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:20:46 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:20:46 user nova-compute[75244]:       <nova:owner>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:user uuid="30e7929c023f45ffa625cc695e38435d">tempest-VolumesSnapshotTestJSON-1543690330-project-member</nova:user>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:project uuid="908ee37c0ad54c3db82d31b804007bad">tempest-VolumesSnapshotTestJSON-1543690330</nova:project>
Nov 29 23:20:46 user nova-compute[75244]:       </nova:owner>
Nov 29 23:20:46 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:20:46 user nova-compute[75244]:       <nova:ports>
Nov 29 23:20:46 user nova-compute[75244]:         <nova:port uuid="80a212b8-7dba-4eed-8946-7552aedac4d1">
Nov 29 23:20:46 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 23:20:46 user nova-compute[75244]:         </nova:port>
Nov 29 23:20:46 user nova-compute[75244]:       </nova:ports>
Nov 29 23:20:46 user nova-compute[75244]:     </nova:instance>
Nov 29 23:20:46 user nova-compute[75244]:   </metadata>
Nov 29 23:20:46 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:20:46 user nova-compute[75244]:     <system>
Nov 29 23:20:46 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:20:46 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:20:46 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:20:46 user nova-compute[75244]:       <entry name="serial">bd19d775-ade7-4f61-a8f4-ce7f7316d30b</entry>
Nov 29 23:20:46 user nova-compute[75244]:       <entry name="uuid">bd19d775-ade7-4f61-a8f4-ce7f7316d30b</entry>
Nov 29 23:20:46 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:20:46 user nova-compute[75244]:     </system>
Nov 29 23:20:46 user nova-compute[75244]:   </sysinfo>
Nov 29 23:20:46 user nova-compute[75244]:   <os>
Nov 29 23:20:46 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:20:46 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:20:46 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:20:46 user nova-compute[75244]:   </os>
Nov 29 23:20:46 user nova-compute[75244]:   <features>
Nov 29 23:20:46 user nova-compute[75244]:     <acpi/>
Nov 29 23:20:46 user nova-compute[75244]:     <apic/>
Nov 29 23:20:46 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:20:46 user nova-compute[75244]:   </features>
Nov 29 23:20:46 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:20:46 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:20:46 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:20:46 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:20:46 user nova-compute[75244]:   </clock>
Nov 29 23:20:46 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:20:46 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:20:46 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:20:46 user nova-compute[75244]:   </cpu>
Nov 29 23:20:46 user nova-compute[75244]:   <devices>
Nov 29 23:20:46 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:20:46 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:20:46 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk"/>
Nov 29 23:20:46 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:20:46 user nova-compute[75244]:     </disk>
Nov 29 23:20:46 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:20:46 user nova-compute[75244]:       <mac address="fa:16:3e:48:24:82"/>
Nov 29 23:20:46 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:46 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:20:46 user nova-compute[75244]:       <target dev="tap80a212b8-7d"/>
Nov 29 23:20:46 user nova-compute[75244]:     </interface>
Nov 29 23:20:46 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:20:46 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/console.log" append="off"/>
Nov 29 23:20:46 user nova-compute[75244]:     </serial>
Nov 29 23:20:46 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:20:46 user nova-compute[75244]:     <video>
Nov 29 23:20:46 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:20:46 user nova-compute[75244]:     </video>
Nov 29 23:20:46 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:20:46 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:20:46 user nova-compute[75244]:     </rng>
Nov 29 23:20:46 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:20:46 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:20:46 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:20:46 user nova-compute[75244]:     </memballoon>
Nov 29 23:20:46 user nova-compute[75244]:   </devices>
Nov 29 23:20:46 user nova-compute[75244]: </domain>
Nov 29 23:20:46 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1793930855',display_name='tempest-VolumesSnapshotTestJSON-instance-1793930855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1793930855',id=37,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd/KA5j7++lFHJMDwNrhzCJmbJa0PV0psgU+HzMQltcY8uohIf4Z4Niq9/wZ1cZOUfI8XPruE7q3wc7dO4P9g6WqVSDMpjx2HT3snujOFVOyRWIvqgYsI/+4TCOMcsAWg==',key_name='tempest-keypair-1148333361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='908ee37c0ad54c3db82d31b804007bad',ramdisk_id='',reservation_id='r-arlfnqtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1543690330',owner_user_name='tempest-VolumesSnapshotTestJSON-1543690330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e7929c023f45ffa625cc695e38435d',uuid=bd19d775-ade7-4f61-a8f4-ce7f7316d30b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converting VIF {"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG os_vif [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '366e095a-ed09-5a84-8b2c-223d548d5e50', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80a212b8-7d, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80a212b8-7d, col_values=(('qos', UUID('7a9766f4-5933-40b1-a251-f71dc1659a75')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80a212b8-7d, col_values=(('external_ids', {'iface-id': '80a212b8-7dba-4eed-8946-7552aedac4d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:24:82', 'vm-uuid': 'bd19d775-ade7-4f61-a8f4-ce7f7316d30b'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:46 user nova-compute[75244]: INFO os_vif [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d')
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No VIF found with MAC fa:16:3e:48:24:82, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-changed-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Refreshing instance network info cache due to event network-changed-80a212b8-7dba-4eed-8946-7552aedac4d1. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] Acquiring lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] Acquired lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:20:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Refreshing network info cache for port 80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG nova.network.neutron [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updated VIF entry in instance network info cache for port 80a212b8-7dba-4eed-8946-7552aedac4d1. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG nova.network.neutron [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updating instance_info_cache with network_info: [{"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ade6cddc-3e06-4b2d-980b-c66eeeb4adfb req-6c71e0e4-28a8-4a76-8b21-03df81c428cd service nova] Releasing lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-09e2b2f6-da3b-43d6-82ce-8d6d24429789 req-0d247f32-2d94-46c6-a1dd-26e910e2c71e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-09e2b2f6-da3b-43d6-82ce-8d6d24429789 req-0d247f32-2d94-46c6-a1dd-26e910e2c71e service nova] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-09e2b2f6-da3b-43d6-82ce-8d6d24429789 req-0d247f32-2d94-46c6-a1dd-26e910e2c71e service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-09e2b2f6-da3b-43d6-82ce-8d6d24429789 req-0d247f32-2d94-46c6-a1dd-26e910e2c71e service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-09e2b2f6-da3b-43d6-82ce-8d6d24429789 req-0d247f32-2d94-46c6-a1dd-26e910e2c71e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] No waiting events found dispatching network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:47 user nova-compute[75244]: WARNING nova.compute.manager [req-09e2b2f6-da3b-43d6-82ce-8d6d24429789 req-0d247f32-2d94-46c6-a1dd-26e910e2c71e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received unexpected event network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 for instance with vm_state building and task_state spawning.
Nov 29 23:20:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:20:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Instance spawned successfully.
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:20:49 user nova-compute[75244]: INFO nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.compute.manager [req-c61daf58-5d03-4bd0-8e30-964f3014df67 req-55298238-93bd-4a41-a194-fb421f10ac78 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c61daf58-5d03-4bd0-8e30-964f3014df67 req-55298238-93bd-4a41-a194-fb421f10ac78 service nova] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c61daf58-5d03-4bd0-8e30-964f3014df67 req-55298238-93bd-4a41-a194-fb421f10ac78 service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c61daf58-5d03-4bd0-8e30-964f3014df67 req-55298238-93bd-4a41-a194-fb421f10ac78 service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:49 user nova-compute[75244]: DEBUG nova.compute.manager [req-c61daf58-5d03-4bd0-8e30-964f3014df67 req-55298238-93bd-4a41-a194-fb421f10ac78 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] No waiting events found dispatching network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:20:49 user nova-compute[75244]: WARNING nova.compute.manager [req-c61daf58-5d03-4bd0-8e30-964f3014df67 req-55298238-93bd-4a41-a194-fb421f10ac78 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received unexpected event network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 for instance with vm_state building and task_state spawning.
Nov 29 23:20:49 user nova-compute[75244]: INFO nova.compute.manager [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Took 6.81 seconds to build instance.
Nov 29 23:20:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-efde890d-7fab-44de-9484-9861da1c3604 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.927s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:20:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:20:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=24.718215942382812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 3c65059e-3b99-4199-8173-e334f87cb932 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f071bd0f-4c00-4230-89f5-31bb4ef16b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:20:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:20:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:20:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:20:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:21:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:21:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:21:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:21:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:21:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:21:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:21:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:21:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-changed-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Refreshing instance network info cache due to event network-changed-75cde73a-80eb-4416-9936-8edbdb42611d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] Acquiring lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] Acquired lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Refreshing network info cache for port 75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:21:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7928MB free_disk=24.68698501586914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 3c65059e-3b99-4199-8173-e334f87cb932 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance f071bd0f-4c00-4230-89f5-31bb4ef16b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'flavor' on Instance uuid 3c65059e-3b99-4199-8173-e334f87cb932 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:51 user nova-compute[75244]: INFO nova.compute.manager [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Attaching volume 862ddced-c7a1-4942-816e-5e5c987dfbec to /dev/vdb
Nov 29 23:21:51 user nova-compute[75244]: DEBUG os_brick.utils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa66d23e-db48-4675-a557-7f3ce39dc1b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dea5e14-c3f0-4381-92bc-5d32cf7b4b13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e4e888-5bf6-4b34-9a9c-e7ffcaf26c0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[99566c64-aed4-41f8-a71c-9854e1b64d31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:21:51 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90ededa-103c-4a39-b5bc-1db2b915db97]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG os_brick.utils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updating existing volume attachment record: 5039daa9-c37b-43f8-bf54-775ebf55808b {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updated VIF entry in instance network info cache for port 75cde73a-80eb-4416-9936-8edbdb42611d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updating instance_info_cache with network_info: [{"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:21:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a1263199-e8bf-47c6-81ef-d3eeaefc8491 req-4075dfa8-6ead-441b-913b-59605de4b2e1 service nova] Releasing lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:21:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:21:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMdmqKiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:21:59 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:21:59 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:21:59 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1515a92b-96e4-4d85-a56a-c47d6c24070a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:21:59 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fce783-cb5d-4cfd-bea9-22e7ddc94da3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec] added
Nov 29 23:21:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09a6567-9230-4dd5-98a4-65dd8e6f41cd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e812e25-dc50-40d8-9272-73de043bb1ca]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMdmqKiS {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMdmqKiS" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c31750-dfd5-4560-895e-a6a7e2302935]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMdmqKiS'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d527c-8116-4eb4-980d-37822c374bc5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028cafd-c9b4-48a6-8045-ea6fed532cc1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:21:59 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:21:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:21:59 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:21:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:21:59 user nova-compute[75244]: INFO nova.compute.manager [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Terminating instance
Nov 29 23:21:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b415df-8442-4f59-8764-b65838129c64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260]
Nov 29 23:21:59 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260] successful.
Nov 29 23:21:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e43b7-d14b-4daa-84af-faa2a595003a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d05c10c-c20a-482b-8d07-a10c5fe4d457]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:21:59 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:21:59 user nova-compute[75244]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec (non-flash)
Nov 29 23:21:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:21:59 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:21:59 user nova-compute[75244]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec (non-flash)
Nov 29 23:21:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d26dd07-0ba9-47ac-a48b-9d8a090d983c]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMdmqKiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f991b5a-070c-402c-ae31-26fc879c109c req-70a86f3e-0508-4dc6-85d6-97f9079e40da service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-vif-unplugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f991b5a-070c-402c-ae31-26fc879c109c req-70a86f3e-0508-4dc6-85d6-97f9079e40da service nova] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f991b5a-070c-402c-ae31-26fc879c109c req-70a86f3e-0508-4dc6-85d6-97f9079e40da service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f991b5a-070c-402c-ae31-26fc879c109c req-70a86f3e-0508-4dc6-85d6-97f9079e40da service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f991b5a-070c-402c-ae31-26fc879c109c req-70a86f3e-0508-4dc6-85d6-97f9079e40da service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] No waiting events found dispatching network-vif-unplugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:21:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f991b5a-070c-402c-ae31-26fc879c109c req-70a86f3e-0508-4dc6-85d6-97f9079e40da service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-vif-unplugged-222a8eb2-6fda-4b46-87d9-537077439138 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:22:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Instance destroyed successfully.
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lazy-loading 'resources' on Instance uuid f071bd0f-4c00-4230-89f5-31bb4ef16b59 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-495674906',display_name='tempest-VolumesNegativeTest-instance-495674906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-495674906',id=36,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:20:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c6aaff9d03b4cbba8dd791fdd1c9592',ramdisk_id='',reservation_id='r-etuyvhhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-834267857',owner_user_name='tempest-VolumesNegativeTest-834267857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:20:17Z,user_data=None,user_id='0ea84d8bd20544ce86605bcf4b735838',uuid=f071bd0f-4c00-4230-89f5-31bb4ef16b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Converting VIF {"id": "222a8eb2-6fda-4b46-87d9-537077439138", "address": "fa:16:3e:c2:11:d6", "network": {"id": "c3968464-5ad5-41f4-b809-525688e65e98", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b80290970abc4429ae733e0247e77aa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap222a8eb2-6f", "ovs_interfaceid": "222a8eb2-6fda-4b46-87d9-537077439138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG os_vif [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap222a8eb2-6f, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d8176b8-893a-4367-a6dd-ae56b0f2ffed) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:00 user nova-compute[75244]: INFO os_vif [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:d6,bridge_name='br-int',has_traffic_filtering=True,id=222a8eb2-6fda-4b46-87d9-537077439138,network=Network(c3968464-5ad5-41f4-b809-525688e65e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap222a8eb2-6f')
Nov 29 23:22:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Deleting instance files /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59_del
Nov 29 23:22:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Deletion of /opt/stack/data/nova/instances/f071bd0f-4c00-4230-89f5-31bb4ef16b59_del complete
Nov 29 23:22:00 user nova-compute[75244]: INFO nova.compute.manager [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 29 23:22:00 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26332383961313138', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383961313138', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.objects.instance [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'flavor' on Instance uuid 3c65059e-3b99-4199-8173-e334f87cb932 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:22:00 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:22:00 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:22:00 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:22:00 user nova-compute[75244]:   <serial>862ddced-c7a1-4942-816e-5e5c987dfbec</serial>
Nov 29 23:22:00 user nova-compute[75244]: </disk>
Nov 29 23:22:00 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:22:00 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Took 0.50 seconds to deallocate network for instance.
Nov 29 23:22:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f6d0676-b0b1-4c11-ae60-5f8bd59fca9a req-cc520301-526e-4dfe-bb56-9fa14188dff6 service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-vif-deleted-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] No VIF found with MAC fa:16:3e:5d:22:8d, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:22:01 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Deleted allocations for instance f071bd0f-4c00-4230-89f5-31bb4ef16b59
Nov 29 23:22:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b6b4e761-fd73-4ab3-a36c-ba552e1c4010 tempest-VolumesNegativeTest-834267857 tempest-VolumesNegativeTest-834267857-project-member] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.732s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-565029d0-fef6-41ac-a13e-6094dcdc55b8 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.974s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-96db6a48-d52d-4f4c-b95a-4df27c9f6922 req-e88e2cd0-cb4f-4a37-99da-d808fb1e11ba service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received event network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-96db6a48-d52d-4f4c-b95a-4df27c9f6922 req-e88e2cd0-cb4f-4a37-99da-d808fb1e11ba service nova] Acquiring lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-96db6a48-d52d-4f4c-b95a-4df27c9f6922 req-e88e2cd0-cb4f-4a37-99da-d808fb1e11ba service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-96db6a48-d52d-4f4c-b95a-4df27c9f6922 req-e88e2cd0-cb4f-4a37-99da-d808fb1e11ba service nova] Lock "f071bd0f-4c00-4230-89f5-31bb4ef16b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-96db6a48-d52d-4f4c-b95a-4df27c9f6922 req-e88e2cd0-cb4f-4a37-99da-d808fb1e11ba service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] No waiting events found dispatching network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:01 user nova-compute[75244]: WARNING nova.compute.manager [req-96db6a48-d52d-4f4c-b95a-4df27c9f6922 req-e88e2cd0-cb4f-4a37-99da-d808fb1e11ba service nova] [instance: f071bd0f-4c00-4230-89f5-31bb4ef16b59] Received unexpected event network-vif-plugged-222a8eb2-6fda-4b46-87d9-537077439138 for instance with vm_state deleted and task_state None.
Nov 29 23:22:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:03 user nova-compute[75244]: INFO nova.compute.manager [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Detaching volume 862ddced-c7a1-4942-816e-5e5c987dfbec
Nov 29 23:22:03 user nova-compute[75244]: INFO nova.virt.block_device [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Attempting to driver detach volume 862ddced-c7a1-4942-816e-5e5c987dfbec from mountpoint /dev/vdb
Nov 29 23:22:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Attempting to detach device vdb from instance 3c65059e-3b99-4199-8173-e334f87cb932 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:22:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:22:03 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:22:03 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:22:03 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:22:03 user nova-compute[75244]:   <serial>862ddced-c7a1-4942-816e-5e5c987dfbec</serial>
Nov 29 23:22:03 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:22:03 user nova-compute[75244]: </disk>
Nov 29 23:22:03 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:22:03 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully detached device vdb from instance 3c65059e-3b99-4199-8173-e334f87cb932 from the persistent domain config.
Nov 29 23:22:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c65059e-3b99-4199-8173-e334f87cb932 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:22:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:22:03 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:22:03 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:22:03 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:22:03 user nova-compute[75244]:   <serial>862ddced-c7a1-4942-816e-5e5c987dfbec</serial>
Nov 29 23:22:03 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:22:03 user nova-compute[75244]: </disk>
Nov 29 23:22:03 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:22:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c65059e-3b99-4199-8173-e334f87cb932 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:22:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:10 user nova-compute[75244]: INFO nova.compute.manager [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Unrescuing
Nov 29 23:22:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquired lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:10 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating instance_info_cache with network_info: [{"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Releasing lock "refresh_cache-34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'flavor' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance destroyed successfully.
Nov 29 23:22:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:22:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:12 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:22:12 user nova-compute[75244]: INFO nova.compute.claims [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Claim successful on node user
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:22:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.policy [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90ad1be3a2154e378d4664b44f610e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8fa63a0b10487daf30296ce2924922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:22:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Creating image(s)
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "/opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "/opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk 1073741824" returned: 0 in 0.048s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Cannot resize image /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Ensure instance console log exists: /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Successfully created port: e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Successfully updated port: e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "refresh_cache-0cefafb9-1dbe-4924-a47c-7a1859f56fd0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquired lock "refresh_cache-0cefafb9-1dbe-4924-a47c-7a1859f56fd0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-changed-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Refreshing instance network info cache due to event network-changed-e17bd51b-b439-45d9-b886-8b79ab3ff72a. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] Acquiring lock "refresh_cache-0cefafb9-1dbe-4924-a47c-7a1859f56fd0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Updating instance_info_cache with network_info: [{"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Releasing lock "refresh_cache-0cefafb9-1dbe-4924-a47c-7a1859f56fd0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Instance network_info: |[{"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] Acquired lock "refresh_cache-0cefafb9-1dbe-4924-a47c-7a1859f56fd0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Refreshing network info cache for port e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Start _get_guest_xml network_info=[{"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:22:15 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:22:15 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1090655521',display_name='tempest-VolumesActionsTest-instance-1090655521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1090655521',id=38,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b8fa63a0b10487daf30296ce2924922',ramdisk_id='',reservation_id='r-nvty3032',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-46289140',owner_user_name='tempest-VolumesActionsTest-46289140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:22:13Z,user_data=None,user_id='90ad1be3a2154e378d4664b44f610e5b',uuid=0cefafb9-1dbe-4924-a47c-7a1859f56fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converting VIF {"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cefafb9-1dbe-4924-a47c-7a1859f56fd0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:22:15 user nova-compute[75244]:   <uuid>0cefafb9-1dbe-4924-a47c-7a1859f56fd0</uuid>
Nov 29 23:22:15 user nova-compute[75244]:   <name>instance-00000026</name>
Nov 29 23:22:15 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:22:15 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:22:15 user nova-compute[75244]:   <metadata>
Nov 29 23:22:15 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:22:15 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:22:15 user nova-compute[75244]:       <nova:name>tempest-VolumesActionsTest-instance-1090655521</nova:name>
Nov 29 23:22:15 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:22:15</nova:creationTime>
Nov 29 23:22:15 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:22:15 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:22:15 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:22:15 user nova-compute[75244]:       <nova:owner>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:user uuid="90ad1be3a2154e378d4664b44f610e5b">tempest-VolumesActionsTest-46289140-project-member</nova:user>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:project uuid="1b8fa63a0b10487daf30296ce2924922">tempest-VolumesActionsTest-46289140</nova:project>
Nov 29 23:22:15 user nova-compute[75244]:       </nova:owner>
Nov 29 23:22:15 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:22:15 user nova-compute[75244]:       <nova:ports>
Nov 29 23:22:15 user nova-compute[75244]:         <nova:port uuid="e17bd51b-b439-45d9-b886-8b79ab3ff72a">
Nov 29 23:22:15 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 23:22:15 user nova-compute[75244]:         </nova:port>
Nov 29 23:22:15 user nova-compute[75244]:       </nova:ports>
Nov 29 23:22:15 user nova-compute[75244]:     </nova:instance>
Nov 29 23:22:15 user nova-compute[75244]:   </metadata>
Nov 29 23:22:15 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:22:15 user nova-compute[75244]:     <system>
Nov 29 23:22:15 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:22:15 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:22:15 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:22:15 user nova-compute[75244]:       <entry name="serial">0cefafb9-1dbe-4924-a47c-7a1859f56fd0</entry>
Nov 29 23:22:15 user nova-compute[75244]:       <entry name="uuid">0cefafb9-1dbe-4924-a47c-7a1859f56fd0</entry>
Nov 29 23:22:15 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:22:15 user nova-compute[75244]:     </system>
Nov 29 23:22:15 user nova-compute[75244]:   </sysinfo>
Nov 29 23:22:15 user nova-compute[75244]:   <os>
Nov 29 23:22:15 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:22:15 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:22:15 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:22:15 user nova-compute[75244]:   </os>
Nov 29 23:22:15 user nova-compute[75244]:   <features>
Nov 29 23:22:15 user nova-compute[75244]:     <acpi/>
Nov 29 23:22:15 user nova-compute[75244]:     <apic/>
Nov 29 23:22:15 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:22:15 user nova-compute[75244]:   </features>
Nov 29 23:22:15 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:22:15 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:22:15 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:22:15 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:22:15 user nova-compute[75244]:   </clock>
Nov 29 23:22:15 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:22:15 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:22:15 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:22:15 user nova-compute[75244]:   </cpu>
Nov 29 23:22:15 user nova-compute[75244]:   <devices>
Nov 29 23:22:15 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:22:15 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:22:15 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk"/>
Nov 29 23:22:15 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:22:15 user nova-compute[75244]:     </disk>
Nov 29 23:22:15 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:22:15 user nova-compute[75244]:       <mac address="fa:16:3e:60:df:45"/>
Nov 29 23:22:15 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:22:15 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:22:15 user nova-compute[75244]:       <target dev="tape17bd51b-b4"/>
Nov 29 23:22:15 user nova-compute[75244]:     </interface>
Nov 29 23:22:15 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:22:15 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/console.log" append="off"/>
Nov 29 23:22:15 user nova-compute[75244]:     </serial>
Nov 29 23:22:15 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:22:15 user nova-compute[75244]:     <video>
Nov 29 23:22:15 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:22:15 user nova-compute[75244]:     </video>
Nov 29 23:22:15 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:22:15 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:22:15 user nova-compute[75244]:     </rng>
Nov 29 23:22:15 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:22:15 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:22:15 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:22:15 user nova-compute[75244]:     </memballoon>
Nov 29 23:22:15 user nova-compute[75244]:   </devices>
Nov 29 23:22:15 user nova-compute[75244]: </domain>
Nov 29 23:22:15 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1090655521',display_name='tempest-VolumesActionsTest-instance-1090655521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1090655521',id=38,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b8fa63a0b10487daf30296ce2924922',ramdisk_id='',reservation_id='r-nvty3032',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-46289140',owner_user_name='tempest-VolumesActionsTest-46289140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:22:13Z,user_data=None,user_id='90ad1be3a2154e378d4664b44f610e5b',uuid=0cefafb9-1dbe-4924-a47c-7a1859f56fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converting VIF {"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG os_vif [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfc5c6ab-0d6a-598b-a0c3-07aa994e600a', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape17bd51b-b4, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape17bd51b-b4, col_values=(('qos', UUID('9ee40bbf-4ac5-449a-adbc-a3e7dce1a7e1')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape17bd51b-b4, col_values=(('external_ids', {'iface-id': 'e17bd51b-b439-45d9-b886-8b79ab3ff72a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:df:45', 'vm-uuid': '0cefafb9-1dbe-4924-a47c-7a1859f56fd0'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:15 user nova-compute[75244]: INFO os_vif [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4')
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a33a4473-0a9e-4287-975a-44bc6f2f393d tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] No VIF found with MAC fa:16:3e:60:df:45, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Updated VIF entry in instance network info cache for port e17bd51b-b439-45d9-b886-8b79ab3ff72a. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Updating instance_info_cache with network_info: [{"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7ee0070a-2402-46be-8791-9e890dced636 req-49944d38-96a5-4141-84fc-7b3bfaea22ab service nova] Releasing lock "refresh_cache-0cefafb9-1dbe-4924-a47c-7a1859f56fd0" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-4b623a3c-b6a6-45d6-95a6-3e0ba7d7bf80 req-a023207c-4701-4b61-ade3-d60b748f7249 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4b623a3c-b6a6-45d6-95a6-3e0ba7d7bf80 req-a023207c-4701-4b61-ade3-d60b748f7249 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4b623a3c-b6a6-45d6-95a6-3e0ba7d7bf80 req-a023207c-4701-4b61-ade3-d60b748f7249 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4b623a3c-b6a6-45d6-95a6-3e0ba7d7bf80 req-a023207c-4701-4b61-ade3-d60b748f7249 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-4b623a3c-b6a6-45d6-95a6-3e0ba7d7bf80 req-a023207c-4701-4b61-ade3-d60b748f7249 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:16 user nova-compute[75244]: WARNING nova.compute.manager [req-4b623a3c-b6a6-45d6-95a6-3e0ba7d7bf80 req-a023207c-4701-4b61-ade3-d60b748f7249 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state None.
Nov 29 23:22:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:18 user nova-compute[75244]: WARNING nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state None.
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:18 user nova-compute[75244]: WARNING nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state None.
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:18 user nova-compute[75244]: WARNING nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state None.
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] No waiting events found dispatching network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:18 user nova-compute[75244]: WARNING nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received unexpected event network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a for instance with vm_state building and task_state spawning.
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] No waiting events found dispatching network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:18 user nova-compute[75244]: WARNING nova.compute.manager [req-985114fc-6577-470f-bbc3-2158cc594821 req-2c21ef34-4001-4561-be7b-7680a0ff82b9 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received unexpected event network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a for instance with vm_state building and task_state spawning.
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:22:19 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Instance spawned successfully.
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:22:19 user nova-compute[75244]: INFO nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 29 23:22:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:22:19 user nova-compute[75244]: INFO nova.compute.manager [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Took 6.56 seconds to build instance.
Nov 29 23:22:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e67d1209-679c-43bc-8c65-2edff007cae3 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.657s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:23 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c65059e-3b99-4199-8173-e334f87cb932 is timed out.
Nov 29 23:22:23 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully detached device vdb from instance 3c65059e-3b99-4199-8173-e334f87cb932 from the live domain config.
Nov 29 23:22:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMdmqKiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:22:23 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e35ae9-c286-44b9-aefb-1f24c667e54c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:22:23 user nova-compute[75244]: No targets found.
Nov 29 23:22:23 user nova-compute[75244]: iSNS:
Nov 29 23:22:23 user nova-compute[75244]: No targets found.
Nov 29 23:22:23 user nova-compute[75244]: STATIC:
Nov 29 23:22:23 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec
Nov 29 23:22:23 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:22:23 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:22:23 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:22:23 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:22:23 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:22:23 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:22:23 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:22:23 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:22:23 user nova-compute[75244]: FIRMWARE:
Nov 29 23:22:23 user nova-compute[75244]: No targets found.
Nov 29 23:22:23 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:22:23 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:22:23 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768e091-5205-40e5-9f47-4103e30d6ea1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc46820e-8b74-44a0-846f-2ec2519a11d1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:22:23 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:22:23 user nova-compute[75244]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec (non-flash)
Nov 29 23:22:23 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:22:23 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:22:23 user nova-compute[75244]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec (non-flash)
Nov 29 23:22:23 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c32d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8443351d-ed89-4780-a7a2-bf8b4df4e04a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f231608-81a8-4ad8-91ea-f7ff9b3c157f]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[216acc34-9b29-4882-9c08-176278a42034]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:22:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38c03e3-bc47-40db-b5db-a7a1cfed308a]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a240d741-b13b-4998-b2c2-8508152ace8c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b680a3f9-9806-4f8e-9a79-5c1aea629e74]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260]
Nov 29 23:22:24 user nova-compute[75244]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec, portal: 172.16.0.220,3260] successful.
Nov 29 23:22:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862ddced-c7a1-4942-816e-5e5c987dfbec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5816a3e-eb89-48f9-bf83-c2bc0a82a480]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] <== disconnect_volume: return (313ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:22:24 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'flavor' on Instance uuid 3c65059e-3b99-4199-8173-e334f87cb932 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e07e3a9f-bc23-41c8-822a-bf5ad6cfad18 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-changed-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Refreshing instance network info cache due to event network-changed-80a212b8-7dba-4eed-8946-7552aedac4d1. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:22:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] Acquiring lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] Acquired lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:33 user nova-compute[75244]: DEBUG nova.network.neutron [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Refreshing network info cache for port 80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG nova.objects.instance [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'flavor' on Instance uuid bd19d775-ade7-4f61-a8f4-ce7f7316d30b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Ignoring supplied device name: /dev/vdb
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:34 user nova-compute[75244]: INFO nova.compute.manager [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Attaching volume 609b545e-8937-4578-9b2a-376184ce5a3c to /dev/vdb
Nov 29 23:22:34 user nova-compute[75244]: DEBUG nova.network.neutron [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updated VIF entry in instance network info cache for port 80a212b8-7dba-4eed-8946-7552aedac4d1. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG nova.network.neutron [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updating instance_info_cache with network_info: [{"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-01fc1002-21a9-4a16-bc02-2dabbcf49f29 req-ab246b20-603c-4079-8114-66e3c590e53e service nova] Releasing lock "refresh_cache-bd19d775-ade7-4f61-a8f4-ce7f7316d30b" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG os_brick.utils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa2bf3-5d9a-4fe2-9146-978f64c66f51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[66401eba-a436-4f85-95d2-5e985bdf8826]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e960d2-7a23-492f-9b28-c75beae91d59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d779c220-0489-4c6c-bdb5-10b94cbe34d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:22:34 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:22:34 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f34d7-2450-42e2-8ce4-1f249238475a]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG os_brick.utils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:22:34 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updating existing volume attachment record: e4d2cc7d-0653-4726-b5db-19fa86401398 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:22:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updating instance_info_cache with network_info: [{"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jekrQMGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:22:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:22:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:22:46 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb1525-c92c-4b6b-b455-482a27371801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:22:46 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ed73d-f975-45ba-8fb2-fa8b718cb69c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c] added
Nov 29 23:22:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2fd0f-f1e2-4e55-b180-cb1d1dec3014]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1716f7dc-b90e-468b-92df-2d5eda867246]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jekrQMGP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jekrQMGP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a346cfe-ab3e-46b0-873b-8cbdad8c5d6e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jekrQMGP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aef86ef-3d70-495c-8d85-00052ba3aca2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ec5eb6-2fa1-459e-8de7-05257f7b9e36]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:22:46 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:22:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:22:46 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:22:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef438cf-4b6b-43bf-a0cc-bbbaeda4e6bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260]
Nov 29 23:22:46 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:22:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b4f0e-5d60-480d-9a9f-551ce5ccee71]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84e870-b96a-4e7e-b4aa-ac372c45e631]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:22:46 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:22:46 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:22:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:22:46 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:22:46 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:22:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ec5fb-4774-4d64-a398-9fb8a0930e88]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:22:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jekrQMGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23364396463313630', 'path': '/dev/sdd'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364396463313630', 'path': '/dev/sdd'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG nova.objects.instance [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'flavor' on Instance uuid bd19d775-ade7-4f61-a8f4-ce7f7316d30b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:22:47 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:22:47 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:22:47 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:22:47 user nova-compute[75244]:   <serial>609b545e-8937-4578-9b2a-376184ce5a3c</serial>
Nov 29 23:22:47 user nova-compute[75244]: </disk>
Nov 29 23:22:47 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No VIF found with MAC fa:16:3e:48:24:82, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-34004d91-c72a-4609-9356-e434e12acca0 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.300s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:22:48 user nova-compute[75244]: INFO nova.compute.claims [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Claim successful on node user
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:22:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: INFO nova.virt.block_device [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Booting with volume f60ddd39-b547-401c-9455-be8a7ec55d47 at /dev/vda
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.policy [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6d9dd0466344edc8b9aad74fd1fe1b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f36d441ef074e09bcb59e29b03b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG os_brick.utils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe11b556-6040-45cd-be0b-9eb4a0c9a755]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc31b1fe-392c-4e1c-8080-f494974e8339]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7900b6-19ea-408a-88b2-5208df2d80ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8396159d-5f68-41c5-9234-ca58300c13e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:22:49 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda30d9-25c5-447e-8980-3f4f05436eee]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG os_brick.utils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating existing volume attachment record: 904f1b51-12ce-40e0-b95e-2ef62d2f50d4 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Successfully created port: 6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:22:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=24.67623519897461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 3c65059e-3b99-4199-8173-e334f87cb932 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0cefafb9-1dbe-4924-a47c-7a1859f56fd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Successfully updated port: 6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-changed-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG nova.compute.manager [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Refreshing instance network info cache due to event network-changed-6730da14-0a14-4e3f-ba87-45ddc06d676a. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:22:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.network.neutron [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance network_info: |[{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Refreshing network info cache for port 6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updated VIF entry in instance network info cache for port 6730da14-0a14-4e3f-ba87-45ddc06d676a. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1879ffbc-f3a9-4371-9c05-ce91d9b18fa3 req-73c8710b-7a89-47c4-9688-7dcf8a98fe91 service nova] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-changed-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Refreshing instance network info cache due to event network-changed-75cde73a-80eb-4416-9936-8edbdb42611d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] Acquiring lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] Acquired lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Refreshing network info cache for port 75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:54 user nova-compute[75244]: INFO nova.compute.manager [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Terminating instance
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-e87c79c7-32d2-4994-be27-2104b7582fd8 req-0b0e3044-5f0a-4506-8b3a-6e884a3d84e9 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-vif-unplugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e87c79c7-32d2-4994-be27-2104b7582fd8 req-0b0e3044-5f0a-4506-8b3a-6e884a3d84e9 service nova] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e87c79c7-32d2-4994-be27-2104b7582fd8 req-0b0e3044-5f0a-4506-8b3a-6e884a3d84e9 service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e87c79c7-32d2-4994-be27-2104b7582fd8 req-0b0e3044-5f0a-4506-8b3a-6e884a3d84e9 service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-e87c79c7-32d2-4994-be27-2104b7582fd8 req-0b0e3044-5f0a-4506-8b3a-6e884a3d84e9 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] No waiting events found dispatching network-vif-unplugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-e87c79c7-32d2-4994-be27-2104b7582fd8 req-0b0e3044-5f0a-4506-8b3a-6e884a3d84e9 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-vif-unplugged-75cde73a-80eb-4416-9936-8edbdb42611d for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updated VIF entry in instance network info cache for port 75cde73a-80eb-4416-9936-8edbdb42611d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updating instance_info_cache with network_info: [{"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4bf859d5-8b18-419a-a83a-a54e08af2d24 req-6ea22acb-6f42-4cb1-9ae4-e599be5fe7d8 service nova] Releasing lock "refresh_cache-3c65059e-3b99-4199-8173-e334f87cb932" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:22:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Instance destroyed successfully.
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'resources' on Instance uuid 3c65059e-3b99-4199-8173-e334f87cb932 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-122740334',display_name='tempest-TestStampPattern-server-122740334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-122740334',id=35,image_ref='a469c5db-8b34-49fc-b83b-c13942c56f2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxte1rpyd5jQaGmUdfHPyQkG0c+iZHTywDrmc5m23eGK8tv2O5fUwNn4LhRvmXk79qHy4OuFi7LT7wqD0Kzwx6FDf7BPhKuTYVdjZFWcl01pmaKjbzmxpXWb8uFBV71Gw==',key_name='tempest-TestStampPattern-1844974625',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8586834ec2a40eea6c8ee777319d909',ramdisk_id='',reservation_id='r-5bwb3ls2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7077e5ec-3f09-45f9-a011-d89eaf58d888',image_min_disk='1',image_min_ram='0',image_owner_id='c8586834ec2a40eea6c8ee777319d909',image_owner_project_name='tempest-TestStampPattern-1117540779',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1117540779-project-member',image_user_id='d52463fb99804a39a7400dd0a62bc7a0',owner_project_name='tempest-TestStampPattern-1117540779',owner_user_name='tempest-TestStampPattern-1117540779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:20:06Z,user_data=None,user_id='d52463fb99804a39a7400dd0a62bc7a0',uuid=3c65059e-3b99-4199-8173-e334f87cb932,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converting VIF {"id": "75cde73a-80eb-4416-9936-8edbdb42611d", "address": "fa:16:3e:5d:22:8d", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75cde73a-80", "ovs_interfaceid": "75cde73a-80eb-4416-9936-8edbdb42611d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG os_vif [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75cde73a-80, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11931dc1-5b0f-4210-b4e4-98c322ab3faa) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:22:54 user nova-compute[75244]: INFO os_vif [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=75cde73a-80eb-4416-9936-8edbdb42611d,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75cde73a-80')
Nov 29 23:22:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Deleting instance files /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932_del
Nov 29 23:22:54 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Deletion of /opt/stack/data/nova/instances/3c65059e-3b99-4199-8173-e334f87cb932_del complete
Nov 29 23:22:55 user nova-compute[75244]: INFO nova.compute.manager [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 23:22:55 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:22:55 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Took 0.51 seconds to deallocate network for instance.
Nov 29 23:22:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:22:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:56 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Deleted allocations for instance 3c65059e-3b99-4199-8173-e334f87cb932
Nov 29 23:22:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-9960faee-2d27-4381-84ba-c588c56884b3 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "3c65059e-3b99-4199-8173-e334f87cb932" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] Acquiring lock "3c65059e-3b99-4199-8173-e334f87cb932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:22:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:22:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] Lock "3c65059e-3b99-4199-8173-e334f87cb932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:22:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] No waiting events found dispatching network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:22:56 user nova-compute[75244]: WARNING nova.compute.manager [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received unexpected event network-vif-plugged-75cde73a-80eb-4416-9936-8edbdb42611d for instance with vm_state deleted and task_state None.
Nov 29 23:22:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-ce086ccf-6aab-4d9d-8c2f-25732624230d req-3c2b9364-aee8-4187-b7f1-d751660b33db service nova] [instance: 3c65059e-3b99-4199-8173-e334f87cb932] Received event network-vif-deleted-75cde73a-80eb-4416-9936-8edbdb42611d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:22:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:22:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:22:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:22:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:22:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:23:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Creating image(s)
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Ensure instance console log exists: /opt/stack/data/nova/instances/1f8fe978-77d1-43af-9ac9-db5276cf3d17/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Start _get_guest_xml network_info=[{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f8fe978-77d1-43af-9ac9-db5276cf3d17', 'attached_at': '', 'detached_at': '', 'volume_id': 'f60ddd39-b547-401c-9455-be8a7ec55d47', 'serial': 'f60ddd39-b547-401c-9455-be8a7ec55d47'}, 'attachment_id': '904f1b51-12ce-40e0-b95e-2ef62d2f50d4', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:23:06 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:23:06 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:23:06 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:23:06 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:23:06 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d329c9a9-4752-439c-9962-804d64903e0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:23:06 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a391d9-a71b-49ff-bfec-ccd4349ad378]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47] added
Nov 29 23:23:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17ee968-6edf-44ec-8c8f-39ca1429d3fc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05af16e-7a9c-4a6b-aa4f-35655f55c89c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fBtMoKLC {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fBtMoKLC" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[682b4add-3232-4b28-adfd-87487e540368]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fBtMoKLC'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[765205ef-8b03-41e9-8a74-a0f2843cbaeb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb60cce-3d2f-4bb5-a865-ec28b2e3d992]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:23:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:23:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[047d3fbd-bb52-4f54-a563-f9a11038aade]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]
Nov 29 23:23:06 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.
Nov 29 23:23:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e02ad6-15e1-4aab-a598-fd76891008a4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f1cb74-5263-4cf2-9310-bd31166c8b73]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:23:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:23:06 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:23:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[58605355-61e9-455b-8d45-94ca6655f5e9]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:23:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23365363335313834', 'path': '/dev/sde'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365363335313834', 'path': '/dev/sde'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1032111597',display_name='tempest-ServerActionsTestOtherA-server-1032111597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1032111597',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-tc1uf20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1f8fe978-77d1-43af-9ac9-db5276cf3d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f8fe978-77d1-43af-9ac9-db5276cf3d17 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:23:07 user nova-compute[75244]:   <uuid>1f8fe978-77d1-43af-9ac9-db5276cf3d17</uuid>
Nov 29 23:23:07 user nova-compute[75244]:   <name>instance-00000027</name>
Nov 29 23:23:07 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:23:07 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:23:07 user nova-compute[75244]:   <metadata>
Nov 29 23:23:07 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:23:07 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:23:07 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherA-server-1032111597</nova:name>
Nov 29 23:23:07 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:23:06</nova:creationTime>
Nov 29 23:23:07 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:23:07 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:23:07 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:23:07 user nova-compute[75244]:       <nova:owner>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:user uuid="c6d9dd0466344edc8b9aad74fd1fe1b0">tempest-ServerActionsTestOtherA-1557642123-project-member</nova:user>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:project uuid="6f36d441ef074e09bcb59e29b03b5e77">tempest-ServerActionsTestOtherA-1557642123</nova:project>
Nov 29 23:23:07 user nova-compute[75244]:       </nova:owner>
Nov 29 23:23:07 user nova-compute[75244]:       <nova:ports>
Nov 29 23:23:07 user nova-compute[75244]:         <nova:port uuid="6730da14-0a14-4e3f-ba87-45ddc06d676a">
Nov 29 23:23:07 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 23:23:07 user nova-compute[75244]:         </nova:port>
Nov 29 23:23:07 user nova-compute[75244]:       </nova:ports>
Nov 29 23:23:07 user nova-compute[75244]:     </nova:instance>
Nov 29 23:23:07 user nova-compute[75244]:   </metadata>
Nov 29 23:23:07 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:23:07 user nova-compute[75244]:     <system>
Nov 29 23:23:07 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:23:07 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:23:07 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:23:07 user nova-compute[75244]:       <entry name="serial">1f8fe978-77d1-43af-9ac9-db5276cf3d17</entry>
Nov 29 23:23:07 user nova-compute[75244]:       <entry name="uuid">1f8fe978-77d1-43af-9ac9-db5276cf3d17</entry>
Nov 29 23:23:07 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:23:07 user nova-compute[75244]:     </system>
Nov 29 23:23:07 user nova-compute[75244]:   </sysinfo>
Nov 29 23:23:07 user nova-compute[75244]:   <os>
Nov 29 23:23:07 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:23:07 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:23:07 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:23:07 user nova-compute[75244]:   </os>
Nov 29 23:23:07 user nova-compute[75244]:   <features>
Nov 29 23:23:07 user nova-compute[75244]:     <acpi/>
Nov 29 23:23:07 user nova-compute[75244]:     <apic/>
Nov 29 23:23:07 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:23:07 user nova-compute[75244]:   </features>
Nov 29 23:23:07 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:23:07 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:23:07 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:23:07 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:23:07 user nova-compute[75244]:   </clock>
Nov 29 23:23:07 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:23:07 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:23:07 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:23:07 user nova-compute[75244]:   </cpu>
Nov 29 23:23:07 user nova-compute[75244]:   <devices>
Nov 29 23:23:07 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:23:07 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:23:07 user nova-compute[75244]:       <source dev="/dev/sde"/>
Nov 29 23:23:07 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:23:07 user nova-compute[75244]:       <serial>f60ddd39-b547-401c-9455-be8a7ec55d47</serial>
Nov 29 23:23:07 user nova-compute[75244]:     </disk>
Nov 29 23:23:07 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:23:07 user nova-compute[75244]:       <mac address="fa:16:3e:32:36:ae"/>
Nov 29 23:23:07 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:23:07 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:23:07 user nova-compute[75244]:       <target dev="tap6730da14-0a"/>
Nov 29 23:23:07 user nova-compute[75244]:     </interface>
Nov 29 23:23:07 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:23:07 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/1f8fe978-77d1-43af-9ac9-db5276cf3d17/console.log" append="off"/>
Nov 29 23:23:07 user nova-compute[75244]:     </serial>
Nov 29 23:23:07 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:23:07 user nova-compute[75244]:     <video>
Nov 29 23:23:07 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:23:07 user nova-compute[75244]:     </video>
Nov 29 23:23:07 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:23:07 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:23:07 user nova-compute[75244]:     </rng>
Nov 29 23:23:07 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:23:07 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:23:07 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:23:07 user nova-compute[75244]:     </memballoon>
Nov 29 23:23:07 user nova-compute[75244]:   </devices>
Nov 29 23:23:07 user nova-compute[75244]: </domain>
Nov 29 23:23:07 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1032111597',display_name='tempest-ServerActionsTestOtherA-server-1032111597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1032111597',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-tc1uf20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1f8fe978-77d1-43af-9ac9-db5276cf3d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG os_vif [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f92768e5-c264-5eb0-a7e6-bfa1bd15c786', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6730da14-0a, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6730da14-0a, col_values=(('qos', UUID('98ca734a-b415-4972-aed9-6895189ef78c')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6730da14-0a, col_values=(('external_ids', {'iface-id': '6730da14-0a14-4e3f-ba87-45ddc06d676a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:36:ae', 'vm-uuid': '1f8fe978-77d1-43af-9ac9-db5276cf3d17'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:07 user nova-compute[75244]: INFO os_vif [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a')
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:23:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No VIF found with MAC fa:16:3e:32:36:ae, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-5db54a26-47dd-4e66-936a-625987dd6354 req-6b2638ec-6908-4e36-be27-fcc7ab9aa2b7 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5db54a26-47dd-4e66-936a-625987dd6354 req-6b2638ec-6908-4e36-be27-fcc7ab9aa2b7 service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5db54a26-47dd-4e66-936a-625987dd6354 req-6b2638ec-6908-4e36-be27-fcc7ab9aa2b7 service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5db54a26-47dd-4e66-936a-625987dd6354 req-6b2638ec-6908-4e36-be27-fcc7ab9aa2b7 service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:09 user nova-compute[75244]: DEBUG nova.compute.manager [req-5db54a26-47dd-4e66-936a-625987dd6354 req-6b2638ec-6908-4e36-be27-fcc7ab9aa2b7 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:23:09 user nova-compute[75244]: WARNING nova.compute.manager [req-5db54a26-47dd-4e66-936a-625987dd6354 req-6b2638ec-6908-4e36-be27-fcc7ab9aa2b7 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state building and task_state spawning.
Nov 29 23:23:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:23:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance spawned successfully.
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-fe479815-7b29-480a-97a2-28d8e9d04a51 req-42ac93d5-a141-4997-9aff-d9dbae7db52f service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fe479815-7b29-480a-97a2-28d8e9d04a51 req-42ac93d5-a141-4997-9aff-d9dbae7db52f service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fe479815-7b29-480a-97a2-28d8e9d04a51 req-42ac93d5-a141-4997-9aff-d9dbae7db52f service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fe479815-7b29-480a-97a2-28d8e9d04a51 req-42ac93d5-a141-4997-9aff-d9dbae7db52f service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-fe479815-7b29-480a-97a2-28d8e9d04a51 req-42ac93d5-a141-4997-9aff-d9dbae7db52f service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:23:11 user nova-compute[75244]: WARNING nova.compute.manager [req-fe479815-7b29-480a-97a2-28d8e9d04a51 req-42ac93d5-a141-4997-9aff-d9dbae7db52f service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state building and task_state spawning.
Nov 29 23:23:11 user nova-compute[75244]: INFO nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 29 23:23:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:23:11 user nova-compute[75244]: INFO nova.compute.manager [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Took 22.79 seconds to build instance.
Nov 29 23:23:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5385cfc0-318f-4444-bacd-1c252d16897a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.900s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:17 user nova-compute[75244]: INFO nova.compute.manager [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Detaching volume 609b545e-8937-4578-9b2a-376184ce5a3c
Nov 29 23:23:17 user nova-compute[75244]: INFO nova.virt.block_device [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Attempting to driver detach volume 609b545e-8937-4578-9b2a-376184ce5a3c from mountpoint /dev/vdb
Nov 29 23:23:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Attempting to detach device vdb from instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:23:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:23:17 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:23:17 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:23:17 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:23:17 user nova-compute[75244]:   <serial>609b545e-8937-4578-9b2a-376184ce5a3c</serial>
Nov 29 23:23:17 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:23:17 user nova-compute[75244]: </disk>
Nov 29 23:23:17 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:23:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully detached device vdb from instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b from the persistent domain config.
Nov 29 23:23:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:23:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:23:17 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:23:17 user nova-compute[75244]:   <source dev="/dev/sdd"/>
Nov 29 23:23:17 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:23:17 user nova-compute[75244]:   <serial>609b545e-8937-4578-9b2a-376184ce5a3c</serial>
Nov 29 23:23:17 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:23:17 user nova-compute[75244]: </disk>
Nov 29 23:23:17 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:23:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:23:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:23:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b is timed out.
Nov 29 23:23:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully detached device vdb from instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b from the live domain config.
Nov 29 23:23:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jekrQMGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:23:38 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748c9b6-65dc-4494-9304-ef8eae9673e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:23:38 user nova-compute[75244]: No targets found.
Nov 29 23:23:38 user nova-compute[75244]: iSNS:
Nov 29 23:23:38 user nova-compute[75244]: No targets found.
Nov 29 23:23:38 user nova-compute[75244]: STATIC:
Nov 29 23:23:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:23:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:23:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:23:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c
Nov 29 23:23:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:38 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:38 user nova-compute[75244]: FIRMWARE:
Nov 29 23:23:38 user nova-compute[75244]: No targets found.
Nov 29 23:23:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:23:38 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:23:38 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[092163d0-e7b3-4313-a519-27041f5f3bb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb26746e-bacc-4ab6-b7ed-42ae5e3f8b25]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:38 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:38 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:23:38 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:23:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:38 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:38 user nova-compute[75244]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c (non-flash)
Nov 29 23:23:38 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:23:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8042edd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c'): ({'sdd'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Removing single pathed devices sdd {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b55da6-1154-40bb-b593-77599b292a94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36e24b-e204-4146-8b90-7b958533cc91]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Flushing IO for device /dev/sdd {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114f1a1-38e0-47ff-a0f6-0a52e9d7838d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[30251129-b5ac-43a9-9e3e-2ddfb0a25136]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] SCSI volumes sdd have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e586a-3900-4819-b3e2-19623d6672a9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb671d-873f-4743-b3a7-f7051c3967db]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260]
Nov 29 23:23:38 user nova-compute[75244]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c, portal: 172.16.0.220,3260] successful.
Nov 29 23:23:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35655a-1c87-45a4-893f-544e6ebefbaa]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== disconnect_volume: return (344ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:23:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'flavor' on Instance uuid bd19d775-ade7-4f61-a8f4-ce7f7316d30b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a7edf52c-38b0-4daf-90b9-96ffcc8c6cec tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.657s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:39 user nova-compute[75244]: INFO nova.compute.manager [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Terminating instance
Nov 29 23:23:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-4ced8e73-c563-4d5c-981e-5e90c5f624ac req-40353bba-0ea3-406f-96de-10fb491fac5d service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-vif-unplugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4ced8e73-c563-4d5c-981e-5e90c5f624ac req-40353bba-0ea3-406f-96de-10fb491fac5d service nova] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4ced8e73-c563-4d5c-981e-5e90c5f624ac req-40353bba-0ea3-406f-96de-10fb491fac5d service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4ced8e73-c563-4d5c-981e-5e90c5f624ac req-40353bba-0ea3-406f-96de-10fb491fac5d service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-4ced8e73-c563-4d5c-981e-5e90c5f624ac req-40353bba-0ea3-406f-96de-10fb491fac5d service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] No waiting events found dispatching network-vif-unplugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:23:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-4ced8e73-c563-4d5c-981e-5e90c5f624ac req-40353bba-0ea3-406f-96de-10fb491fac5d service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-vif-unplugged-80a212b8-7dba-4eed-8946-7552aedac4d1 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:23:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Instance destroyed successfully.
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.objects.instance [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'resources' on Instance uuid bd19d775-ade7-4f61-a8f4-ce7f7316d30b {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1793930855',display_name='tempest-VolumesSnapshotTestJSON-instance-1793930855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1793930855',id=37,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd/KA5j7++lFHJMDwNrhzCJmbJa0PV0psgU+HzMQltcY8uohIf4Z4Niq9/wZ1cZOUfI8XPruE7q3wc7dO4P9g6WqVSDMpjx2HT3snujOFVOyRWIvqgYsI/+4TCOMcsAWg==',key_name='tempest-keypair-1148333361',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='908ee37c0ad54c3db82d31b804007bad',ramdisk_id='',reservation_id='r-arlfnqtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1543690330',owner_user_name='tempest-VolumesSnapshotTestJSON-1543690330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e7929c023f45ffa625cc695e38435d',uuid=bd19d775-ade7-4f61-a8f4-ce7f7316d30b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converting VIF {"id": "80a212b8-7dba-4eed-8946-7552aedac4d1", "address": "fa:16:3e:48:24:82", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80a212b8-7d", "ovs_interfaceid": "80a212b8-7dba-4eed-8946-7552aedac4d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_vif [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80a212b8-7d, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a9766f4-5933-40b1-a251-f71dc1659a75) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:40 user nova-compute[75244]: INFO os_vif [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:24:82,bridge_name='br-int',has_traffic_filtering=True,id=80a212b8-7dba-4eed-8946-7552aedac4d1,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80a212b8-7d')
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jekrQMGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:23:40 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed6aa8-6080-4d97-9495-e92b2b30b664]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:23:40 user nova-compute[75244]: No targets found.
Nov 29 23:23:40 user nova-compute[75244]: iSNS:
Nov 29 23:23:40 user nova-compute[75244]: No targets found.
Nov 29 23:23:40 user nova-compute[75244]: STATIC:
Nov 29 23:23:40 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:23:40 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:40 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:40 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:23:40 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:40 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:40 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:23:40 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:23:40 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:23:40 user nova-compute[75244]: FIRMWARE:
Nov 29 23:23:40 user nova-compute[75244]: No targets found.
Nov 29 23:23:40 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:23:40 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:23:40 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609b545e-8937-4578-9b2a-376184ce5a3c', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.085s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ac450-2ba5-417d-935c-3ed9d4238f8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c019fc61-6296-47a5-adbd-b1f0aecd0bca]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:40 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:40 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:23:40 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:23:40 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:23:40 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:23:40 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804202c20>, {}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Disconnecting from: [] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.159s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== disconnect_volume: return (160ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:23:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Deleting instance files /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b_del
Nov 29 23:23:40 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Deletion of /opt/stack/data/nova/instances/bd19d775-ade7-4f61-a8f4-ce7f7316d30b_del complete
Nov 29 23:23:40 user nova-compute[75244]: INFO nova.compute.manager [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 29 23:23:40 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:23:40 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:23:41 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Took 1.25 seconds to deallocate network for instance.
Nov 29 23:23:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-0e9167dd-7af1-437d-b69c-e597f5010faf req-951cae47-da3f-449c-8659-7d6155722031 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-vif-deleted-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:41 user nova-compute[75244]: WARNING nova.volume.cinder [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Attachment e4d2cc7d-0653-4726-b5db-19fa86401398 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e4d2cc7d-0653-4726-b5db-19fa86401398. (HTTP 404) (Request-ID: req-2e1e4ff2-8804-469b-9885-af6a5695ced8)
Nov 29 23:23:41 user nova-compute[75244]: INFO nova.compute.manager [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Took 0.06 seconds to detach 1 volumes for instance.
Nov 29 23:23:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-0b9e234d-0545-4f6d-857d-4cceaecf81ce req-f370696e-8ca6-49b3-b2fe-bdc9fec32816 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received event network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0b9e234d-0545-4f6d-857d-4cceaecf81ce req-f370696e-8ca6-49b3-b2fe-bdc9fec32816 service nova] Acquiring lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0b9e234d-0545-4f6d-857d-4cceaecf81ce req-f370696e-8ca6-49b3-b2fe-bdc9fec32816 service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0b9e234d-0545-4f6d-857d-4cceaecf81ce req-f370696e-8ca6-49b3-b2fe-bdc9fec32816 service nova] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-0b9e234d-0545-4f6d-857d-4cceaecf81ce req-f370696e-8ca6-49b3-b2fe-bdc9fec32816 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] No waiting events found dispatching network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:23:41 user nova-compute[75244]: WARNING nova.compute.manager [req-0b9e234d-0545-4f6d-857d-4cceaecf81ce req-f370696e-8ca6-49b3-b2fe-bdc9fec32816 service nova] [instance: bd19d775-ade7-4f61-a8f4-ce7f7316d30b] Received unexpected event network-vif-plugged-80a212b8-7dba-4eed-8946-7552aedac4d1 for instance with vm_state deleted and task_state None.
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:23:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.827s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:42 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Deleted allocations for instance bd19d775-ade7-4f61-a8f4-ce7f7316d30b
Nov 29 23:23:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-eee894cb-d01a-4a50-85c7-dc20bd1ce706 tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "bd19d775-ade7-4f61-a8f4-ce7f7316d30b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.373s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating instance_info_cache with network_info: [{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:23:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:47 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:23:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:23:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8099MB free_disk=24.701553344726562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 7077e5ec-3f09-45f9-a011-d89eaf58d888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0cefafb9-1dbe-4924-a47c-7a1859f56fd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:23:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:23:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:23:50 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:23:50 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:23:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:23:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:51 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:51 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-changed-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Refreshing instance network info cache due to event network-changed-99a1270e-6789-4836-b124-3bf904239ba2. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] Acquiring lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] Acquired lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Refreshing network info cache for port 99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:54 user nova-compute[75244]: INFO nova.compute.manager [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Terminating instance
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-93e01059-47b7-4b14-bcb3-d5fc52629ddd req-ce0ae52f-985b-403b-9a61-5e573da23a9e service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-vif-unplugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-93e01059-47b7-4b14-bcb3-d5fc52629ddd req-ce0ae52f-985b-403b-9a61-5e573da23a9e service nova] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-93e01059-47b7-4b14-bcb3-d5fc52629ddd req-ce0ae52f-985b-403b-9a61-5e573da23a9e service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-93e01059-47b7-4b14-bcb3-d5fc52629ddd req-ce0ae52f-985b-403b-9a61-5e573da23a9e service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-93e01059-47b7-4b14-bcb3-d5fc52629ddd req-ce0ae52f-985b-403b-9a61-5e573da23a9e service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] No waiting events found dispatching network-vif-unplugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-93e01059-47b7-4b14-bcb3-d5fc52629ddd req-ce0ae52f-985b-403b-9a61-5e573da23a9e service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-vif-unplugged-99a1270e-6789-4836-b124-3bf904239ba2 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updated VIF entry in instance network info cache for port 99a1270e-6789-4836-b124-3bf904239ba2. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG nova.network.neutron [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating instance_info_cache with network_info: [{"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:23:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3fc0c5ed-3fd9-478f-a03e-1aa520d9596b req-3a6659c2-db07-4083-9e8b-49485bd0bcae service nova] Releasing lock "refresh_cache-7077e5ec-3f09-45f9-a011-d89eaf58d888" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:23:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Instance destroyed successfully.
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.objects.instance [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lazy-loading 'resources' on Instance uuid 7077e5ec-3f09-45f9-a011-d89eaf58d888 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-30234130',display_name='tempest-TestStampPattern-server-30234130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-30234130',id=32,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxte1rpyd5jQaGmUdfHPyQkG0c+iZHTywDrmc5m23eGK8tv2O5fUwNn4LhRvmXk79qHy4OuFi7LT7wqD0Kzwx6FDf7BPhKuTYVdjZFWcl01pmaKjbzmxpXWb8uFBV71Gw==',key_name='tempest-TestStampPattern-1844974625',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8586834ec2a40eea6c8ee777319d909',ramdisk_id='',reservation_id='r-j7ay331b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1117540779',owner_user_name='tempest-TestStampPattern-1117540779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:19:56Z,user_data=None,user_id='d52463fb99804a39a7400dd0a62bc7a0',uuid=7077e5ec-3f09-45f9-a011-d89eaf58d888,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converting VIF {"id": "99a1270e-6789-4836-b124-3bf904239ba2", "address": "fa:16:3e:35:52:ea", "network": {"id": "ba7cee08-8c9e-4468-8fd3-444f352ce5f0", "bridge": "br-int", "label": "tempest-TestStampPattern-883491034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8586834ec2a40eea6c8ee777319d909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a1270e-67", "ovs_interfaceid": "99a1270e-6789-4836-b124-3bf904239ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG os_vif [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99a1270e-67, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c9e9932-a765-48f2-8a85-3ef5c718c968) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:23:55 user nova-compute[75244]: INFO os_vif [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:52:ea,bridge_name='br-int',has_traffic_filtering=True,id=99a1270e-6789-4836-b124-3bf904239ba2,network=Network(ba7cee08-8c9e-4468-8fd3-444f352ce5f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a1270e-67')
Nov 29 23:23:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Deleting instance files /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888_del
Nov 29 23:23:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Deletion of /opt/stack/data/nova/instances/7077e5ec-3f09-45f9-a011-d89eaf58d888_del complete
Nov 29 23:23:55 user nova-compute[75244]: INFO nova.compute.manager [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 23:23:55 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:23:55 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Took 0.44 seconds to deallocate network for instance.
Nov 29 23:23:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-f7febb95-97c7-41a4-b38b-a9ca77bf39e8 req-ae7df666-f49a-423f-9908-c6907cba2398 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-vif-deleted-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:56 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Deleted allocations for instance 7077e5ec-3f09-45f9-a011-d89eaf58d888
Nov 29 23:23:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-88834239-5323-4835-8bcc-b22210b09841 tempest-TestStampPattern-1117540779 tempest-TestStampPattern-1117540779-project-member] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-05d683eb-c2ef-4016-8a71-afd0fc035abc req-953126f0-35af-4b09-83cc-1e44464ea628 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received event network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-05d683eb-c2ef-4016-8a71-afd0fc035abc req-953126f0-35af-4b09-83cc-1e44464ea628 service nova] Acquiring lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-05d683eb-c2ef-4016-8a71-afd0fc035abc req-953126f0-35af-4b09-83cc-1e44464ea628 service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-05d683eb-c2ef-4016-8a71-afd0fc035abc req-953126f0-35af-4b09-83cc-1e44464ea628 service nova] Lock "7077e5ec-3f09-45f9-a011-d89eaf58d888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:23:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-05d683eb-c2ef-4016-8a71-afd0fc035abc req-953126f0-35af-4b09-83cc-1e44464ea628 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] No waiting events found dispatching network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:23:56 user nova-compute[75244]: WARNING nova.compute.manager [req-05d683eb-c2ef-4016-8a71-afd0fc035abc req-953126f0-35af-4b09-83cc-1e44464ea628 service nova] [instance: 7077e5ec-3f09-45f9-a011-d89eaf58d888] Received unexpected event network-vif-plugged-99a1270e-6789-4836-b124-3bf904239ba2 for instance with vm_state deleted and task_state None.
Nov 29 23:23:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:23:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:24:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:01 user nova-compute[75244]: INFO nova.compute.manager [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Terminating instance
Nov 29 23:24:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-c1bd0566-0f93-4c61-b304-af5481904f84 req-5dcc63e4-e836-4ed6-a3d6-dea2530cb705 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c1bd0566-0f93-4c61-b304-af5481904f84 req-5dcc63e4-e836-4ed6-a3d6-dea2530cb705 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c1bd0566-0f93-4c61-b304-af5481904f84 req-5dcc63e4-e836-4ed6-a3d6-dea2530cb705 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c1bd0566-0f93-4c61-b304-af5481904f84 req-5dcc63e4-e836-4ed6-a3d6-dea2530cb705 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-c1bd0566-0f93-4c61-b304-af5481904f84 req-5dcc63e4-e836-4ed6-a3d6-dea2530cb705 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-c1bd0566-0f93-4c61-b304-af5481904f84 req-5dcc63e4-e836-4ed6-a3d6-dea2530cb705 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-unplugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Instance destroyed successfully.
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.objects.instance [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'resources' on Instance uuid 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1256519036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1256519036',id=34,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:20:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-7t6km07m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:22:16Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=34c3ab5b-1a14-4756-8909-3b0c66b6a8b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "address": "fa:16:3e:94:6c:41", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap602929c7-87", "ovs_interfaceid": "602929c7-87cd-4cfe-9e23-ba81c6e54c26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_vif [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap602929c7-87, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=320ac638-5046-4988-9b89-b57321baf944) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:02 user nova-compute[75244]: INFO os_vif [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:6c:41,bridge_name='br-int',has_traffic_filtering=True,id=602929c7-87cd-4cfe-9e23-ba81c6e54c26,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap602929c7-87')
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UuGSFOcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:24:02 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc9d44b-e65c-4016-a3e6-fd4de8af6b8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:24:02 user nova-compute[75244]: No targets found.
Nov 29 23:24:02 user nova-compute[75244]: iSNS:
Nov 29 23:24:02 user nova-compute[75244]: No targets found.
Nov 29 23:24:02 user nova-compute[75244]: STATIC:
Nov 29 23:24:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:24:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:24:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:24:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:24:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:24:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:24:02 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793
Nov 29 23:24:02 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:24:02 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:24:02 user nova-compute[75244]: FIRMWARE:
Nov 29 23:24:02 user nova-compute[75244]: No targets found.
Nov 29 23:24:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:24:02 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:24:02 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61a3a5a-a165-4f75-a764-7c79ff363e31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e19af8-2bbe-47a8-9040-04ef678fbf9d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:02 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:24:02 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:24:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:02 user nova-compute[75244]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 (non-flash)
Nov 29 23:24:02 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:24:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043ed090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b7eb72-aa55-48b3-aa36-1c794f374f20]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa0545-e37d-45f4-90d0-6797e9391381]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd7eaf-33cf-48f0-8ed5-2194857adb14]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3971f0-8a0c-4220-9420-61b07eefa137]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[55748311-8324-487a-9880-2760ae14188a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62396cc-d7d4-41ac-90da-8caa6cc1cba0]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260]
Nov 29 23:24:02 user nova-compute[75244]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793, portal: 172.16.0.220,3260] successful.
Nov 29 23:24:02 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecdf8c9d-af01-46a4-b6f7-cf825a706793 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[50be978a-1ed9-4dec-801b-9fe51a07dadf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== disconnect_volume: return (334ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:24:02 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:24:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Deleting instance files /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4_del
Nov 29 23:24:02 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Deletion of /opt/stack/data/nova/instances/34c3ab5b-1a14-4756-8909-3b0c66b6a8b4_del complete
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.compute.manager [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 23:24:03 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.compute.manager [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Terminating instance
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Took 0.40 seconds to deallocate network for instance.
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-5e1d6032-4716-48fb-af28-4205019fdded req-70be3ec5-f595-4e19-9b06-f1bf0c0abbf1 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-deleted-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.compute.manager [req-5e1d6032-4716-48fb-af28-4205019fdded req-70be3ec5-f595-4e19-9b06-f1bf0c0abbf1 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Neutron deleted interface 602929c7-87cd-4cfe-9e23-ba81c6e54c26; detaching it from the instance and deleting it from the info cache
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-5e1d6032-4716-48fb-af28-4205019fdded req-70be3ec5-f595-4e19-9b06-f1bf0c0abbf1 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-5e1d6032-4716-48fb-af28-4205019fdded req-70be3ec5-f595-4e19-9b06-f1bf0c0abbf1 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Detach interface failed, port_id=602929c7-87cd-4cfe-9e23-ba81c6e54c26, reason: Instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Instance destroyed successfully.
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lazy-loading 'resources' on Instance uuid 0cefafb9-1dbe-4924-a47c-7a1859f56fd0 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1090655521',display_name='tempest-VolumesActionsTest-instance-1090655521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1090655521',id=38,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:22:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b8fa63a0b10487daf30296ce2924922',ramdisk_id='',reservation_id='r-nvty3032',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-46289140',owner_user_name='tempest-VolumesActionsTest-46289140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:22:19Z,user_data=None,user_id='90ad1be3a2154e378d4664b44f610e5b',uuid=0cefafb9-1dbe-4924-a47c-7a1859f56fd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converting VIF {"id": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "address": "fa:16:3e:60:df:45", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape17bd51b-b4", "ovs_interfaceid": "e17bd51b-b439-45d9-b886-8b79ab3ff72a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG os_vif [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape17bd51b-b4, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ee40bbf-4ac5-449a-adbc-a3e7dce1a7e1) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:03 user nova-compute[75244]: INFO os_vif [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:df:45,bridge_name='br-int',has_traffic_filtering=True,id=e17bd51b-b439-45d9-b886-8b79ab3ff72a,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape17bd51b-b4')
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Deleting instance files /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0_del
Nov 29 23:24:03 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Deletion of /opt/stack/data/nova/instances/0cefafb9-1dbe-4924-a47c-7a1859f56fd0_del complete
Nov 29 23:24:04 user nova-compute[75244]: INFO nova.compute.manager [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Acquiring lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] No waiting events found dispatching network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:04 user nova-compute[75244]: WARNING nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Received unexpected event network-vif-plugged-602929c7-87cd-4cfe-9e23-ba81c6e54c26 for instance with vm_state active and task_state deleting.
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-vif-unplugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] No waiting events found dispatching network-vif-unplugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-vif-unplugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Acquiring lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] No waiting events found dispatching network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:04 user nova-compute[75244]: WARNING nova.compute.manager [req-019903b4-6ffb-4391-a90e-aa24ada33ee1 req-f86d8e10-18ff-4e8c-af13-3d2d08e89b39 service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received unexpected event network-vif-plugged-e17bd51b-b439-45d9-b886-8b79ab3ff72a for instance with vm_state active and task_state deleting.
Nov 29 23:24:04 user nova-compute[75244]: INFO nova.compute.manager [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4] Took 0.80 seconds to detach 1 volumes for instance.
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:04 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Took 0.48 seconds to deallocate network for instance.
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:04 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Deleted allocations for instance 34c3ab5b-1a14-4756-8909-3b0c66b6a8b4
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-36382d61-e416-46ab-94b8-7da1ce6ecad5 tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "34c3ab5b-1a14-4756-8909-3b0c66b6a8b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.844s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:04 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Deleted allocations for instance 0cefafb9-1dbe-4924-a47c-7a1859f56fd0
Nov 29 23:24:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b5565d02-5b87-4954-80bc-d0fca6e547c4 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "0cefafb9-1dbe-4924-a47c-7a1859f56fd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.598s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-b9595b87-0460-4b8a-97b3-e55508567d2c req-59436ef9-c6a5-4e1e-affb-18ce59443ecf service nova] [instance: 0cefafb9-1dbe-4924-a47c-7a1859f56fd0] Received event network-vif-deleted-e17bd51b-b439-45d9-b886-8b79ab3ff72a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:24:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:24:28 user nova-compute[75244]: INFO nova.compute.claims [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Claim successful on node user
Nov 29 23:24:28 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:24:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.policy [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30e7929c023f45ffa625cc695e38435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908ee37c0ad54c3db82d31b804007bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:24:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Creating image(s)
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "/opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "/opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk 1073741824" returned: 0 in 0.049s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Successfully created port: 8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:24:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Cannot resize image /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Ensure instance console log exists: /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Successfully updated port: 8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquired lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-changed-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Refreshing instance network info cache due to event network-changed-8416ee13-b303-43ec-aac5-7097b5c9799b. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] Acquiring lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.neutron [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updating instance_info_cache with network_info: [{"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Releasing lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Instance network_info: |[{"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] Acquired lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.neutron [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Refreshing network info cache for port 8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Start _get_guest_xml network_info=[{"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:24:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:30 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1681440888',display_name='tempest-VolumesSnapshotTestJSON-instance-1681440888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1681440888',id=40,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBNTEJjTuyxY0p0bPhrfBNE5/8IffMCntJbR3W6ksUnu1O03IUxdzohY2rTIzHZiAhU3ULNTcDvx+fssx6hRlGqJB1OPvB8garIMLusExajhYaRrgNMRw1wWRreU1B27w==',key_name='tempest-keypair-2057952895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='908ee37c0ad54c3db82d31b804007bad',ramdisk_id='',reservation_id='r-ebaoadic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1543690330',owner_user_name='tempest-VolumesSnapshotTestJSON-1543690330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e7929c023f45ffa625cc695e38435d',uuid=dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converting VIF {"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.objects.instance [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'pci_devices' on Instance uuid dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:24:30 user nova-compute[75244]:   <uuid>dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65</uuid>
Nov 29 23:24:30 user nova-compute[75244]:   <name>instance-00000028</name>
Nov 29 23:24:30 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:24:30 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:24:30 user nova-compute[75244]:   <metadata>
Nov 29 23:24:30 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:24:30 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:24:30 user nova-compute[75244]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1681440888</nova:name>
Nov 29 23:24:30 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:24:30</nova:creationTime>
Nov 29 23:24:30 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:24:30 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:24:30 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:24:30 user nova-compute[75244]:       <nova:owner>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:user uuid="30e7929c023f45ffa625cc695e38435d">tempest-VolumesSnapshotTestJSON-1543690330-project-member</nova:user>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:project uuid="908ee37c0ad54c3db82d31b804007bad">tempest-VolumesSnapshotTestJSON-1543690330</nova:project>
Nov 29 23:24:30 user nova-compute[75244]:       </nova:owner>
Nov 29 23:24:30 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:24:30 user nova-compute[75244]:       <nova:ports>
Nov 29 23:24:30 user nova-compute[75244]:         <nova:port uuid="8416ee13-b303-43ec-aac5-7097b5c9799b">
Nov 29 23:24:30 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 23:24:30 user nova-compute[75244]:         </nova:port>
Nov 29 23:24:30 user nova-compute[75244]:       </nova:ports>
Nov 29 23:24:30 user nova-compute[75244]:     </nova:instance>
Nov 29 23:24:30 user nova-compute[75244]:   </metadata>
Nov 29 23:24:30 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:24:30 user nova-compute[75244]:     <system>
Nov 29 23:24:30 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:24:30 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:24:30 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:24:30 user nova-compute[75244]:       <entry name="serial">dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65</entry>
Nov 29 23:24:30 user nova-compute[75244]:       <entry name="uuid">dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65</entry>
Nov 29 23:24:30 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:24:30 user nova-compute[75244]:     </system>
Nov 29 23:24:30 user nova-compute[75244]:   </sysinfo>
Nov 29 23:24:30 user nova-compute[75244]:   <os>
Nov 29 23:24:30 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:24:30 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:24:30 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:24:30 user nova-compute[75244]:   </os>
Nov 29 23:24:30 user nova-compute[75244]:   <features>
Nov 29 23:24:30 user nova-compute[75244]:     <acpi/>
Nov 29 23:24:30 user nova-compute[75244]:     <apic/>
Nov 29 23:24:30 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:24:30 user nova-compute[75244]:   </features>
Nov 29 23:24:30 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:24:30 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:24:30 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:24:30 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:24:30 user nova-compute[75244]:   </clock>
Nov 29 23:24:30 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:24:30 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:24:30 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:24:30 user nova-compute[75244]:   </cpu>
Nov 29 23:24:30 user nova-compute[75244]:   <devices>
Nov 29 23:24:30 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:24:30 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:24:30 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk"/>
Nov 29 23:24:30 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:24:30 user nova-compute[75244]:     </disk>
Nov 29 23:24:30 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:24:30 user nova-compute[75244]:       <mac address="fa:16:3e:59:d1:65"/>
Nov 29 23:24:30 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:24:30 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:24:30 user nova-compute[75244]:       <target dev="tap8416ee13-b3"/>
Nov 29 23:24:30 user nova-compute[75244]:     </interface>
Nov 29 23:24:30 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:24:30 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/console.log" append="off"/>
Nov 29 23:24:30 user nova-compute[75244]:     </serial>
Nov 29 23:24:30 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:24:30 user nova-compute[75244]:     <video>
Nov 29 23:24:30 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:24:30 user nova-compute[75244]:     </video>
Nov 29 23:24:30 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:24:30 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:24:30 user nova-compute[75244]:     </rng>
Nov 29 23:24:30 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:24:30 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:24:30 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:24:30 user nova-compute[75244]:     </memballoon>
Nov 29 23:24:30 user nova-compute[75244]:   </devices>
Nov 29 23:24:30 user nova-compute[75244]: </domain>
Nov 29 23:24:30 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1681440888',display_name='tempest-VolumesSnapshotTestJSON-instance-1681440888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1681440888',id=40,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBNTEJjTuyxY0p0bPhrfBNE5/8IffMCntJbR3W6ksUnu1O03IUxdzohY2rTIzHZiAhU3ULNTcDvx+fssx6hRlGqJB1OPvB8garIMLusExajhYaRrgNMRw1wWRreU1B27w==',key_name='tempest-keypair-2057952895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='908ee37c0ad54c3db82d31b804007bad',ramdisk_id='',reservation_id='r-ebaoadic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1543690330',owner_user_name='tempest-VolumesSnapshotTestJSON-1543690330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e7929c023f45ffa625cc695e38435d',uuid=dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converting VIF {"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG os_vif [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb295357-fcd0-52a2-89c5-ad24dadcdb37', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8416ee13-b3, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8416ee13-b3, col_values=(('qos', UUID('0dc4e95d-2920-4152-add0-28d2e1c47c16')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8416ee13-b3, col_values=(('external_ids', {'iface-id': '8416ee13-b303-43ec-aac5-7097b5c9799b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:d1:65', 'vm-uuid': 'dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:30 user nova-compute[75244]: INFO os_vif [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3')
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:24:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No VIF found with MAC fa:16:3e:59:d1:65, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:24:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updated VIF entry in instance network info cache for port 8416ee13-b303-43ec-aac5-7097b5c9799b. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:24:31 user nova-compute[75244]: DEBUG nova.network.neutron [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updating instance_info_cache with network_info: [{"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-34394635-8ba3-45c1-8aad-66101b1ab487 req-e7f9b388-2df1-4071-a337-214547e39041 service nova] Releasing lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-4aa18bb6-b7e1-456b-a8f7-96216787640e req-d1c5630d-51bc-481c-af15-5e960463df03 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4aa18bb6-b7e1-456b-a8f7-96216787640e req-d1c5630d-51bc-481c-af15-5e960463df03 service nova] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4aa18bb6-b7e1-456b-a8f7-96216787640e req-d1c5630d-51bc-481c-af15-5e960463df03 service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4aa18bb6-b7e1-456b-a8f7-96216787640e req-d1c5630d-51bc-481c-af15-5e960463df03 service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-4aa18bb6-b7e1-456b-a8f7-96216787640e req-d1c5630d-51bc-481c-af15-5e960463df03 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] No waiting events found dispatching network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:32 user nova-compute[75244]: WARNING nova.compute.manager [req-4aa18bb6-b7e1-456b-a8f7-96216787640e req-d1c5630d-51bc-481c-af15-5e960463df03 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received unexpected event network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b for instance with vm_state building and task_state spawning.
Nov 29 23:24:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:24:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Instance spawned successfully.
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-c0a8f3b2-76ba-4b3a-82bf-a48388481267 req-917b491f-1305-4ee4-8ca0-48f0331ec549 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c0a8f3b2-76ba-4b3a-82bf-a48388481267 req-917b491f-1305-4ee4-8ca0-48f0331ec549 service nova] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c0a8f3b2-76ba-4b3a-82bf-a48388481267 req-917b491f-1305-4ee4-8ca0-48f0331ec549 service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c0a8f3b2-76ba-4b3a-82bf-a48388481267 req-917b491f-1305-4ee4-8ca0-48f0331ec549 service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-c0a8f3b2-76ba-4b3a-82bf-a48388481267 req-917b491f-1305-4ee4-8ca0-48f0331ec549 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] No waiting events found dispatching network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:34 user nova-compute[75244]: WARNING nova.compute.manager [req-c0a8f3b2-76ba-4b3a-82bf-a48388481267 req-917b491f-1305-4ee4-8ca0-48f0331ec549 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received unexpected event network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b for instance with vm_state building and task_state spawning.
Nov 29 23:24:34 user nova-compute[75244]: INFO nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 29 23:24:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:24:34 user nova-compute[75244]: INFO nova.compute.manager [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Took 5.82 seconds to build instance.
Nov 29 23:24:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-a01e55e4-83f7-4fa3-a730-2a4f87afdaee tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.915s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-changed-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG nova.compute.manager [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Refreshing instance network info cache due to event network-changed-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Refreshing network info cache for port b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated VIF entry in instance network info cache for port b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG nova.network.neutron [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-87d15093-cedd-47cd-a9f1-0a04b991acda req-2d3dd782-7e31-45d3-b8f8-7c0c660e9bf4 service nova] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Stashing vm_state: active {{(pid=75244) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:24:41 user nova-compute[75244]: INFO nova.compute.claims [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Claim successful on node user
Nov 29 23:24:41 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating resource usage from migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6
Nov 29 23:24:41 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.311s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:41 user nova-compute[75244]: INFO nova.compute.manager [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Migrating
Nov 29 23:24:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:41 user nova-compute[75244]: DEBUG nova.network.neutron [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-changed-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Refreshing instance network info cache due to event network-changed-6730da14-0a14-4e3f-ba87-45ddc06d676a. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.network.neutron [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Refreshing network info cache for port 6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Starting migrate_disk_and_power_off {{(pid=75244) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-32598384-0a69-4bb6-97cc-112152bdf25f req-25493aab-5f69-4d52-b21b-c4ca48b6dfab service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-unplugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-32598384-0a69-4bb6-97cc-112152bdf25f req-25493aab-5f69-4d52-b21b-c4ca48b6dfab service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-32598384-0a69-4bb6-97cc-112152bdf25f req-25493aab-5f69-4d52-b21b-c4ca48b6dfab service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-32598384-0a69-4bb6-97cc-112152bdf25f req-25493aab-5f69-4d52-b21b-c4ca48b6dfab service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-32598384-0a69-4bb6-97cc-112152bdf25f req-25493aab-5f69-4d52-b21b-c4ca48b6dfab service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-unplugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:42 user nova-compute[75244]: WARNING nova.compute.manager [req-32598384-0a69-4bb6-97cc-112152bdf25f req-25493aab-5f69-4d52-b21b-c4ca48b6dfab service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-unplugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state active and task_state resize_migrating.
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updated VIF entry in instance network info cache for port 6730da14-0a14-4e3f-ba87-45ddc06d676a. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG nova.network.neutron [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7409013d-cd14-433a-ae3b-4746e01c8b73 req-655757de-f685-4c38-a02c-2734261da5b9 service nova] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance destroyed successfully.
Nov 29 23:24:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1032111597',display_name='tempest-ServerActionsTestOtherA-server-1032111597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1032111597',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:23:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-tc1uf20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1f8fe978-77d1-43af-9ac9-db5276cf3d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6730da14-0a, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98ca734a-b415-4972-aed9-6895189ef78c) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:43 user nova-compute[75244]: INFO os_vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a')
Nov 29 23:24:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:24:43 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc5dc2-eeff-46c8-8a6b-3db7884b9dee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:24:43 user nova-compute[75244]: No targets found.
Nov 29 23:24:43 user nova-compute[75244]: iSNS:
Nov 29 23:24:43 user nova-compute[75244]: No targets found.
Nov 29 23:24:43 user nova-compute[75244]: STATIC:
Nov 29 23:24:43 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:24:43 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:24:43 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:24:43 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:24:43 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:24:43 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:24:43 user nova-compute[75244]: FIRMWARE:
Nov 29 23:24:43 user nova-compute[75244]: No targets found.
Nov 29 23:24:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:24:43 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:24:43 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[da44dd2f-3231-4e7c-beb8-4472363c08db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[832acc48-997d-4614-ba8c-51819b25bf28]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:43 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:24:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:43 user nova-compute[75244]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:24:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47'): ({'sde'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Removing single pathed devices sde {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b5a78-79ee-4b7c-b5ba-80381529fd2e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a4e115-3515-451f-9646-ca2b71420c09]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flushing IO for device /dev/sde {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe718d2-4d5a-4fd3-a95c-030aed83e1d7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5087f39-f3cd-4dbe-bc31-651bb33eb099]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] SCSI volumes sde have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23365363335313834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6bc2e0a2', '/dev/disk/by-id/scsi-1SCST_BIO6bc2e0a2-3e635184c9fd04de') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dfb7bc-0628-40da-adb8-550dccb8d656]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2711b1-d284-4517-a8bf-817895952cad]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13ebbfc-8f06-4681-b12f-71c990855278]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]
Nov 29 23:24:43 user nova-compute[75244]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.
Nov 29 23:24:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe755c7-f0f5-4f18-880f-0814d015d089]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== disconnect_volume: return (294ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:24:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG nova.network.neutron [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Port 6730da14-0a14-4e3f-ba87-45ddc06d676a binding to destination host user is already ACTIVE {{(pid=75244) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG nova.network.neutron [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-c2e03bec-90c7-4c9d-b9bd-1e38bbb97780 req-cb065ab3-cb39-41a6-8a15-99e27343c83c service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c2e03bec-90c7-4c9d-b9bd-1e38bbb97780 req-cb065ab3-cb39-41a6-8a15-99e27343c83c service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c2e03bec-90c7-4c9d-b9bd-1e38bbb97780 req-cb065ab3-cb39-41a6-8a15-99e27343c83c service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c2e03bec-90c7-4c9d-b9bd-1e38bbb97780 req-cb065ab3-cb39-41a6-8a15-99e27343c83c service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-c2e03bec-90c7-4c9d-b9bd-1e38bbb97780 req-cb065ab3-cb39-41a6-8a15-99e27343c83c service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:44 user nova-compute[75244]: WARNING nova.compute.manager [req-c2e03bec-90c7-4c9d-b9bd-1e38bbb97780 req-cb065ab3-cb39-41a6-8a15-99e27343c83c service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state active and task_state resize_migrated.
Nov 29 23:24:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[021cc32f-6d6b-43c0-bcc5-d3261050a654]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b39f93-1d94-41ad-a566-4a9857c4f8eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68da9c8-1c1a-4596-9f92-65a3cd42258d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[52466813-5b47-4b5e-aa27-99b211dcdbbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:24:45 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:24:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a4d14-64bb-4b1a-9b25-4ab9c2d610de]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:24:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:24:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:24:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:24:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=24.825489044189453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Applying migration context for instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 as it has an incoming, in-progress migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6. Migration status is post-migrating {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 23:24:50 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating resource usage from migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:50 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:24:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:52 user nova-compute[75244]: INFO nova.compute.manager [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Terminating instance
Nov 29 23:24:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-445e3699-47de-4398-a63c-4774d5577777 req-f3529177-35c9-4289-8887-2db27a712d00 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-vif-unplugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-445e3699-47de-4398-a63c-4774d5577777 req-f3529177-35c9-4289-8887-2db27a712d00 service nova] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-445e3699-47de-4398-a63c-4774d5577777 req-f3529177-35c9-4289-8887-2db27a712d00 service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-445e3699-47de-4398-a63c-4774d5577777 req-f3529177-35c9-4289-8887-2db27a712d00 service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-445e3699-47de-4398-a63c-4774d5577777 req-f3529177-35c9-4289-8887-2db27a712d00 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] No waiting events found dispatching network-vif-unplugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-445e3699-47de-4398-a63c-4774d5577777 req-f3529177-35c9-4289-8887-2db27a712d00 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-vif-unplugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Instance destroyed successfully.
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'resources' on Instance uuid 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652482759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652482759',id=31,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-0uvje3ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:17:27Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "address": "fa:16:3e:90:b5:a0", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4bee46e-25", "ovs_interfaceid": "d4bee46e-259a-44ed-ac7b-5b81488002f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_vif [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4bee46e-25, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecc99b3f-19e9-413b-95b4-f98b00a64e93) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:53 user nova-compute[75244]: INFO os_vif [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:b5:a0,bridge_name='br-int',has_traffic_filtering=True,id=d4bee46e-259a-44ed-ac7b-5b81488002f0,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4bee46e-25')
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Deleting instance files /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd_del
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Deletion of /opt/stack/data/nova/instances/0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd_del complete
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.compute.manager [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Starting finish_migration {{(pid=75244) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Creating image(s)
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Ensure instance console log exists: /opt/stack/data/nova/instances/1f8fe978-77d1-43af-9ac9-db5276cf3d17/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Start _get_guest_xml network_info=[{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1f8fe978-77d1-43af-9ac9-db5276cf3d17', 'attached_at': '2023-11-29T23:24:53.000000', 'detached_at': '', 'volume_id': 'f60ddd39-b547-401c-9455-be8a7ec55d47', 'serial': 'f60ddd39-b547-401c-9455-be8a7ec55d47'}, 'attachment_id': '6f111018-514f-4c8d-94e2-d76e11f63418', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:24:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:24:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:24:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:24:53 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ac6e3-06d9-4c31-bec3-9e1237a28174]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:24:53 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d2852-e8a0-49b1-a0fd-de708f0b987c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47] added
Nov 29 23:24:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b67c1-3b72-4b44-8e34-515fbe23476c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5c8c8b-c533-40c9-a5b3-3a26d8c4d204]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fBtMoKLC {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fBtMoKLC" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca81052-027c-4598-a661-712f6266ef4f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fBtMoKLC'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a276f9a-8db0-4c71-97f1-260a15545b98]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc8459e-3a13-4a30-8a43-4489082300a8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ee6d9-ebfd-44f3-9193-f912ba112659]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]
Nov 29 23:24:53 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.
Nov 29 23:24:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6fea70-6e63-4934-9fb6-9786b324fc57]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-46e2778d-397b-455d-b280-f46ebc70983b req-f8addc11-10b8-4337-aa00-5708ed6b52f3 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-vif-deleted-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.compute.manager [req-46e2778d-397b-455d-b280-f46ebc70983b req-f8addc11-10b8-4337-aa00-5708ed6b52f3 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Neutron deleted interface d4bee46e-259a-44ed-ac7b-5b81488002f0; detaching it from the instance and deleting it from the info cache
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-46e2778d-397b-455d-b280-f46ebc70983b req-f8addc11-10b8-4337-aa00-5708ed6b52f3 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d163f6-df25-43c9-9c74-497145d047a5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:53 user nova-compute[75244]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:24:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:24:53 user nova-compute[75244]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:24:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:53 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Took 0.56 seconds to deallocate network for instance.
Nov 29 23:24:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-46e2778d-397b-455d-b280-f46ebc70983b req-f8addc11-10b8-4337-aa00-5708ed6b52f3 service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Detach interface failed, port_id=d4bee46e-259a-44ed-ac7b-5b81488002f0, reason: Instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0720ac8-96cb-488d-8abb-2e3552941491]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:24:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:54 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Deleted allocations for instance 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e651e34b-c30e-4172-92a1-8a15b911cd4b tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-41c7d131-b085-4e7e-b3ef-a5dcd327d976 req-482c5b6f-abce-47ed-86e6-d3605da46e9d service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received event network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-41c7d131-b085-4e7e-b3ef-a5dcd327d976 req-482c5b6f-abce-47ed-86e6-d3605da46e9d service nova] Acquiring lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-41c7d131-b085-4e7e-b3ef-a5dcd327d976 req-482c5b6f-abce-47ed-86e6-d3605da46e9d service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-41c7d131-b085-4e7e-b3ef-a5dcd327d976 req-482c5b6f-abce-47ed-86e6-d3605da46e9d service nova] Lock "0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-41c7d131-b085-4e7e-b3ef-a5dcd327d976 req-482c5b6f-abce-47ed-86e6-d3605da46e9d service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] No waiting events found dispatching network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:54 user nova-compute[75244]: WARNING nova.compute.manager [req-41c7d131-b085-4e7e-b3ef-a5dcd327d976 req-482c5b6f-abce-47ed-86e6-d3605da46e9d service nova] [instance: 0ba3455c-4f9b-4ef4-92e6-3ea6eb6dc4fd] Received unexpected event network-vif-plugged-d4bee46e-259a-44ed-ac7b-5b81488002f0 for instance with vm_state deleted and task_state None.
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23365363335313834', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:24:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365363335313834', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:24:55 user nova-compute[75244]: INFO nova.compute.claims [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Claim successful on node user
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1032111597',display_name='tempest-ServerActionsTestOtherA-server-1032111597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1032111597',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:23:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-tc1uf20t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1f8fe978-77d1-43af-9ac9-db5276cf3d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:24:55 user nova-compute[75244]:   <uuid>1f8fe978-77d1-43af-9ac9-db5276cf3d17</uuid>
Nov 29 23:24:55 user nova-compute[75244]:   <name>instance-00000027</name>
Nov 29 23:24:55 user nova-compute[75244]:   <memory>2097152</memory>
Nov 29 23:24:55 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:24:55 user nova-compute[75244]:   <metadata>
Nov 29 23:24:55 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:24:55 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:24:55 user nova-compute[75244]:       <nova:name>tempest-ServerActionsTestOtherA-server-1032111597</nova:name>
Nov 29 23:24:55 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:24:53</nova:creationTime>
Nov 29 23:24:55 user nova-compute[75244]:       <nova:flavor name="m1.small">
Nov 29 23:24:55 user nova-compute[75244]:         <nova:memory>2048</nova:memory>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:disk>20</nova:disk>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:24:55 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:24:55 user nova-compute[75244]:       <nova:owner>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:user uuid="c6d9dd0466344edc8b9aad74fd1fe1b0">tempest-ServerActionsTestOtherA-1557642123-project-member</nova:user>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:project uuid="6f36d441ef074e09bcb59e29b03b5e77">tempest-ServerActionsTestOtherA-1557642123</nova:project>
Nov 29 23:24:55 user nova-compute[75244]:       </nova:owner>
Nov 29 23:24:55 user nova-compute[75244]:       <nova:ports>
Nov 29 23:24:55 user nova-compute[75244]:         <nova:port uuid="6730da14-0a14-4e3f-ba87-45ddc06d676a">
Nov 29 23:24:55 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 23:24:55 user nova-compute[75244]:         </nova:port>
Nov 29 23:24:55 user nova-compute[75244]:       </nova:ports>
Nov 29 23:24:55 user nova-compute[75244]:     </nova:instance>
Nov 29 23:24:55 user nova-compute[75244]:   </metadata>
Nov 29 23:24:55 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:24:55 user nova-compute[75244]:     <system>
Nov 29 23:24:55 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:24:55 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:24:55 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:24:55 user nova-compute[75244]:       <entry name="serial">1f8fe978-77d1-43af-9ac9-db5276cf3d17</entry>
Nov 29 23:24:55 user nova-compute[75244]:       <entry name="uuid">1f8fe978-77d1-43af-9ac9-db5276cf3d17</entry>
Nov 29 23:24:55 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:24:55 user nova-compute[75244]:     </system>
Nov 29 23:24:55 user nova-compute[75244]:   </sysinfo>
Nov 29 23:24:55 user nova-compute[75244]:   <os>
Nov 29 23:24:55 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:24:55 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:24:55 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:24:55 user nova-compute[75244]:   </os>
Nov 29 23:24:55 user nova-compute[75244]:   <features>
Nov 29 23:24:55 user nova-compute[75244]:     <acpi/>
Nov 29 23:24:55 user nova-compute[75244]:     <apic/>
Nov 29 23:24:55 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:24:55 user nova-compute[75244]:   </features>
Nov 29 23:24:55 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:24:55 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:24:55 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:24:55 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:24:55 user nova-compute[75244]:   </clock>
Nov 29 23:24:55 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:24:55 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:24:55 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:24:55 user nova-compute[75244]:   </cpu>
Nov 29 23:24:55 user nova-compute[75244]:   <devices>
Nov 29 23:24:55 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:24:55 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:24:55 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:24:55 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:24:55 user nova-compute[75244]:       <serial>f60ddd39-b547-401c-9455-be8a7ec55d47</serial>
Nov 29 23:24:55 user nova-compute[75244]:     </disk>
Nov 29 23:24:55 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:24:55 user nova-compute[75244]:       <mac address="fa:16:3e:32:36:ae"/>
Nov 29 23:24:55 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:24:55 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:24:55 user nova-compute[75244]:       <target dev="tap6730da14-0a"/>
Nov 29 23:24:55 user nova-compute[75244]:     </interface>
Nov 29 23:24:55 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:24:55 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/1f8fe978-77d1-43af-9ac9-db5276cf3d17/console.log" append="off"/>
Nov 29 23:24:55 user nova-compute[75244]:     </serial>
Nov 29 23:24:55 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:24:55 user nova-compute[75244]:     <video>
Nov 29 23:24:55 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:24:55 user nova-compute[75244]:     </video>
Nov 29 23:24:55 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:24:55 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:24:55 user nova-compute[75244]:     </rng>
Nov 29 23:24:55 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:24:55 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:24:55 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:24:55 user nova-compute[75244]:     </memballoon>
Nov 29 23:24:55 user nova-compute[75244]:   </devices>
Nov 29 23:24:55 user nova-compute[75244]: </domain>
Nov 29 23:24:55 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1032111597',display_name='tempest-ServerActionsTestOtherA-server-1032111597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1032111597',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:23:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-tc1uf20t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1f8fe978-77d1-43af-9ac9-db5276cf3d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1099265098-network", "vif_mac": "fa:16:3e:32:36:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG os_vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f92768e5-c264-5eb0-a7e6-bfa1bd15c786', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6730da14-0a, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6730da14-0a, col_values=(('qos', UUID('08aee8a8-0af3-43f2-891e-8a67a8f8e422')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6730da14-0a, col_values=(('external_ids', {'iface-id': '6730da14-0a14-4e3f-ba87-45ddc06d676a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:36:ae', 'vm-uuid': '1f8fe978-77d1-43af-9ac9-db5276cf3d17'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:55 user nova-compute[75244]: INFO os_vif [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a')
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] No VIF found with MAC fa:16:3e:32:36:ae, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:24:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.policy [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90ad1be3a2154e378d4664b44f610e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8fa63a0b10487daf30296ce2924922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:24:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Creating image(s)
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "/opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "/opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "/opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk 1073741824" returned: 0 in 0.051s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Successfully created port: 3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.224s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Cannot resize image /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Ensure instance console log exists: /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-00c587c7-d594-4c86-9bbb-3eb73fc0fddc req-d7f375a1-1636-4ff5-91e4-1e45a7f8713a service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-00c587c7-d594-4c86-9bbb-3eb73fc0fddc req-d7f375a1-1636-4ff5-91e4-1e45a7f8713a service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-00c587c7-d594-4c86-9bbb-3eb73fc0fddc req-d7f375a1-1636-4ff5-91e4-1e45a7f8713a service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-00c587c7-d594-4c86-9bbb-3eb73fc0fddc req-d7f375a1-1636-4ff5-91e4-1e45a7f8713a service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-00c587c7-d594-4c86-9bbb-3eb73fc0fddc req-d7f375a1-1636-4ff5-91e4-1e45a7f8713a service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:56 user nova-compute[75244]: WARNING nova.compute.manager [req-00c587c7-d594-4c86-9bbb-3eb73fc0fddc req-d7f375a1-1636-4ff5-91e4-1e45a7f8713a service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state active and task_state resize_finish.
Nov 29 23:24:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Successfully updated port: 3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "refresh_cache-da3316cc-c58e-4d3c-af4a-75e5f6b97d75" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquired lock "refresh_cache-da3316cc-c58e-4d3c-af4a-75e5f6b97d75" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:56 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-changed-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Refreshing instance network info cache due to event network-changed-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] Acquiring lock "refresh_cache-da3316cc-c58e-4d3c-af4a-75e5f6b97d75" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Updating instance_info_cache with network_info: [{"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Releasing lock "refresh_cache-da3316cc-c58e-4d3c-af4a-75e5f6b97d75" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Instance network_info: |[{"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] Acquired lock "refresh_cache-da3316cc-c58e-4d3c-af4a-75e5f6b97d75" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Refreshing network info cache for port 3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Start _get_guest_xml network_info=[{"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:24:57 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:57 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1139086801',display_name='tempest-VolumesActionsTest-instance-1139086801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1139086801',id=41,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b8fa63a0b10487daf30296ce2924922',ramdisk_id='',reservation_id='r-mbyw2tsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-46289140',owner_user_name='tempest-VolumesActionsTest-46289140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:56Z,user_data=None,user_id='90ad1be3a2154e378d4664b44f610e5b',uuid=da3316cc-c58e-4d3c-af4a-75e5f6b97d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converting VIF {"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lazy-loading 'pci_devices' on Instance uuid da3316cc-c58e-4d3c-af4a-75e5f6b97d75 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:24:57 user nova-compute[75244]:   <uuid>da3316cc-c58e-4d3c-af4a-75e5f6b97d75</uuid>
Nov 29 23:24:57 user nova-compute[75244]:   <name>instance-00000029</name>
Nov 29 23:24:57 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:24:57 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:24:57 user nova-compute[75244]:   <metadata>
Nov 29 23:24:57 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:24:57 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:24:57 user nova-compute[75244]:       <nova:name>tempest-VolumesActionsTest-instance-1139086801</nova:name>
Nov 29 23:24:57 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:24:57</nova:creationTime>
Nov 29 23:24:57 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:24:57 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:24:57 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:24:57 user nova-compute[75244]:       <nova:owner>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:user uuid="90ad1be3a2154e378d4664b44f610e5b">tempest-VolumesActionsTest-46289140-project-member</nova:user>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:project uuid="1b8fa63a0b10487daf30296ce2924922">tempest-VolumesActionsTest-46289140</nova:project>
Nov 29 23:24:57 user nova-compute[75244]:       </nova:owner>
Nov 29 23:24:57 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:24:57 user nova-compute[75244]:       <nova:ports>
Nov 29 23:24:57 user nova-compute[75244]:         <nova:port uuid="3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7">
Nov 29 23:24:57 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 23:24:57 user nova-compute[75244]:         </nova:port>
Nov 29 23:24:57 user nova-compute[75244]:       </nova:ports>
Nov 29 23:24:57 user nova-compute[75244]:     </nova:instance>
Nov 29 23:24:57 user nova-compute[75244]:   </metadata>
Nov 29 23:24:57 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:24:57 user nova-compute[75244]:     <system>
Nov 29 23:24:57 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:24:57 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:24:57 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:24:57 user nova-compute[75244]:       <entry name="serial">da3316cc-c58e-4d3c-af4a-75e5f6b97d75</entry>
Nov 29 23:24:57 user nova-compute[75244]:       <entry name="uuid">da3316cc-c58e-4d3c-af4a-75e5f6b97d75</entry>
Nov 29 23:24:57 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:24:57 user nova-compute[75244]:     </system>
Nov 29 23:24:57 user nova-compute[75244]:   </sysinfo>
Nov 29 23:24:57 user nova-compute[75244]:   <os>
Nov 29 23:24:57 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:24:57 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:24:57 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:24:57 user nova-compute[75244]:   </os>
Nov 29 23:24:57 user nova-compute[75244]:   <features>
Nov 29 23:24:57 user nova-compute[75244]:     <acpi/>
Nov 29 23:24:57 user nova-compute[75244]:     <apic/>
Nov 29 23:24:57 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:24:57 user nova-compute[75244]:   </features>
Nov 29 23:24:57 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:24:57 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:24:57 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:24:57 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:24:57 user nova-compute[75244]:   </clock>
Nov 29 23:24:57 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:24:57 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:24:57 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:24:57 user nova-compute[75244]:   </cpu>
Nov 29 23:24:57 user nova-compute[75244]:   <devices>
Nov 29 23:24:57 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:24:57 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:24:57 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk"/>
Nov 29 23:24:57 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:24:57 user nova-compute[75244]:     </disk>
Nov 29 23:24:57 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:24:57 user nova-compute[75244]:       <mac address="fa:16:3e:06:f8:1f"/>
Nov 29 23:24:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:24:57 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:24:57 user nova-compute[75244]:       <target dev="tap3dd4cd9c-8f"/>
Nov 29 23:24:57 user nova-compute[75244]:     </interface>
Nov 29 23:24:57 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:24:57 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/console.log" append="off"/>
Nov 29 23:24:57 user nova-compute[75244]:     </serial>
Nov 29 23:24:57 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:24:57 user nova-compute[75244]:     <video>
Nov 29 23:24:57 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:24:57 user nova-compute[75244]:     </video>
Nov 29 23:24:57 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:24:57 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:24:57 user nova-compute[75244]:     </rng>
Nov 29 23:24:57 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:24:57 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:24:57 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:24:57 user nova-compute[75244]:     </memballoon>
Nov 29 23:24:57 user nova-compute[75244]:   </devices>
Nov 29 23:24:57 user nova-compute[75244]: </domain>
Nov 29 23:24:57 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1139086801',display_name='tempest-VolumesActionsTest-instance-1139086801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1139086801',id=41,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b8fa63a0b10487daf30296ce2924922',ramdisk_id='',reservation_id='r-mbyw2tsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-46289140',owner_user_name='tempest-VolumesActionsTest-46289140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:24:56Z,user_data=None,user_id='90ad1be3a2154e378d4664b44f610e5b',uuid=da3316cc-c58e-4d3c-af4a-75e5f6b97d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converting VIF {"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG os_vif [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '895ee390-094b-5698-8dc3-51443bd6a366', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd4cd9c-8f, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dd4cd9c-8f, col_values=(('qos', UUID('9cd5de43-57f9-40a6-b4ab-ff5332d1822e')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dd4cd9c-8f, col_values=(('external_ids', {'iface-id': '3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:f8:1f', 'vm-uuid': 'da3316cc-c58e-4d3c-af4a-75e5f6b97d75'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:57 user nova-compute[75244]: INFO os_vif [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f')
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] No VIF found with MAC fa:16:3e:06:f8:1f, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Updated VIF entry in instance network info cache for port 3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Updating instance_info_cache with network_info: [{"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:24:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-33a81518-904f-415c-866b-c7b660f9948c req-6f0a1d4c-354c-436b-8258-e73be8b40b21 service nova] Releasing lock "refresh_cache-da3316cc-c58e-4d3c-af4a-75e5f6b97d75" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:24:58 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance running successfully.
Nov 29 23:24:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Failed to set time: agent not configured {{(pid=75244) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-888c5b5f-29e4-48fc-a12e-8def8609a348 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] finish_migration finished successfully. {{(pid=75244) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-55b4290b-0141-42f8-8bed-d863af30bef6 req-7e4ddbc8-3805-4bf1-a8a4-940d7481f3b6 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-55b4290b-0141-42f8-8bed-d863af30bef6 req-7e4ddbc8-3805-4bf1-a8a4-940d7481f3b6 service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-55b4290b-0141-42f8-8bed-d863af30bef6 req-7e4ddbc8-3805-4bf1-a8a4-940d7481f3b6 service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-55b4290b-0141-42f8-8bed-d863af30bef6 req-7e4ddbc8-3805-4bf1-a8a4-940d7481f3b6 service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-55b4290b-0141-42f8-8bed-d863af30bef6 req-7e4ddbc8-3805-4bf1-a8a4-940d7481f3b6 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:58 user nova-compute[75244]: WARNING nova.compute.manager [req-55b4290b-0141-42f8-8bed-d863af30bef6 req-7e4ddbc8-3805-4bf1-a8a4-940d7481f3b6 service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state active and task_state resize_finish.
Nov 29 23:24:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-f6df10a7-1432-457d-840b-e08bc559706b req-47ac2020-b43b-4b2a-b423-0fdd6aac4549 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f6df10a7-1432-457d-840b-e08bc559706b req-47ac2020-b43b-4b2a-b423-0fdd6aac4549 service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f6df10a7-1432-457d-840b-e08bc559706b req-47ac2020-b43b-4b2a-b423-0fdd6aac4549 service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f6df10a7-1432-457d-840b-e08bc559706b req-47ac2020-b43b-4b2a-b423-0fdd6aac4549 service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG nova.compute.manager [req-f6df10a7-1432-457d-840b-e08bc559706b req-47ac2020-b43b-4b2a-b423-0fdd6aac4549 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:24:59 user nova-compute[75244]: WARNING nova.compute.manager [req-f6df10a7-1432-457d-840b-e08bc559706b req-47ac2020-b43b-4b2a-b423-0fdd6aac4549 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state building and task_state spawning.
Nov 29 23:24:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:24:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:25:01 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Instance spawned successfully.
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-3cfb91d2-be11-48e0-900f-dab0727fd553 req-ef171292-8868-4cc6-b83e-a059cb38b590 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3cfb91d2-be11-48e0-900f-dab0727fd553 req-ef171292-8868-4cc6-b83e-a059cb38b590 service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3cfb91d2-be11-48e0-900f-dab0727fd553 req-ef171292-8868-4cc6-b83e-a059cb38b590 service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3cfb91d2-be11-48e0-900f-dab0727fd553 req-ef171292-8868-4cc6-b83e-a059cb38b590 service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.compute.manager [req-3cfb91d2-be11-48e0-900f-dab0727fd553 req-ef171292-8868-4cc6-b83e-a059cb38b590 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:25:01 user nova-compute[75244]: WARNING nova.compute.manager [req-3cfb91d2-be11-48e0-900f-dab0727fd553 req-ef171292-8868-4cc6-b83e-a059cb38b590 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state building and task_state spawning.
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:01 user nova-compute[75244]: INFO nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 29 23:25:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:25:01 user nova-compute[75244]: INFO nova.compute.manager [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Took 6.52 seconds to build instance.
Nov 29 23:25:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b4ac12f9-53f1-421b-b067-c834fd15e97c tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.654s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:25:14 user nova-compute[75244]: INFO nova.compute.claims [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Claim successful on node user
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:25:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.policy [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3362c152fe8d4daea107df07bca933ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b493900b974a96b519797f02ddc070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:25:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Creating image(s)
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "/opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "/opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "/opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.270s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk 1073741824" returned: 0 in 0.050s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Successfully created port: c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Cannot resize image /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Ensure instance console log exists: /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Successfully updated port: c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquired lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-changed-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Refreshing instance network info cache due to event network-changed-c4ec64ce-eb63-42c9-8a02-4a4854b6c369. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] Acquiring lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating instance_info_cache with network_info: [{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Releasing lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Instance network_info: |[{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] Acquired lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Refreshing network info cache for port c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Start _get_guest_xml network_info=[{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:25:16 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:25:16 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-549419621',display_name='tempest-SnapshotDataIntegrityTests-server-549419621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-549419621',id=42,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTScmKtmz+BExfQzr0NW2vxfGh1tACmuiaZE87OPoBtotyd4Y8b3ZMiJhclbIuUg2fIWPPUv8OLs0m1UoY6P/H6d7qYr/aXNheBXSBCEEIzRupudi1Ll8uChjJSUpwX3w==',key_name='tempest-keypair-107456481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1b493900b974a96b519797f02ddc070',ramdisk_id='',reservation_id='r-txro7k71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1578029874',owner_user_name='tempest-SnapshotDataIntegrityTests-1578029874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3362c152fe8d4daea107df07bca933ae',uuid=de7e455f-0838-41b7-bf6d-218e5a0559ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Converting VIF {"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'pci_devices' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:25:16 user nova-compute[75244]:   <uuid>de7e455f-0838-41b7-bf6d-218e5a0559ba</uuid>
Nov 29 23:25:16 user nova-compute[75244]:   <name>instance-0000002a</name>
Nov 29 23:25:16 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:25:16 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:25:16 user nova-compute[75244]:   <metadata>
Nov 29 23:25:16 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:25:16 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:25:16 user nova-compute[75244]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-549419621</nova:name>
Nov 29 23:25:16 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:25:16</nova:creationTime>
Nov 29 23:25:16 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:25:16 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:25:16 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:25:16 user nova-compute[75244]:       <nova:owner>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:user uuid="3362c152fe8d4daea107df07bca933ae">tempest-SnapshotDataIntegrityTests-1578029874-project-member</nova:user>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:project uuid="c1b493900b974a96b519797f02ddc070">tempest-SnapshotDataIntegrityTests-1578029874</nova:project>
Nov 29 23:25:16 user nova-compute[75244]:       </nova:owner>
Nov 29 23:25:16 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:25:16 user nova-compute[75244]:       <nova:ports>
Nov 29 23:25:16 user nova-compute[75244]:         <nova:port uuid="c4ec64ce-eb63-42c9-8a02-4a4854b6c369">
Nov 29 23:25:16 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 23:25:16 user nova-compute[75244]:         </nova:port>
Nov 29 23:25:16 user nova-compute[75244]:       </nova:ports>
Nov 29 23:25:16 user nova-compute[75244]:     </nova:instance>
Nov 29 23:25:16 user nova-compute[75244]:   </metadata>
Nov 29 23:25:16 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:25:16 user nova-compute[75244]:     <system>
Nov 29 23:25:16 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:25:16 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:25:16 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:25:16 user nova-compute[75244]:       <entry name="serial">de7e455f-0838-41b7-bf6d-218e5a0559ba</entry>
Nov 29 23:25:16 user nova-compute[75244]:       <entry name="uuid">de7e455f-0838-41b7-bf6d-218e5a0559ba</entry>
Nov 29 23:25:16 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:25:16 user nova-compute[75244]:     </system>
Nov 29 23:25:16 user nova-compute[75244]:   </sysinfo>
Nov 29 23:25:16 user nova-compute[75244]:   <os>
Nov 29 23:25:16 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:25:16 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:25:16 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:25:16 user nova-compute[75244]:   </os>
Nov 29 23:25:16 user nova-compute[75244]:   <features>
Nov 29 23:25:16 user nova-compute[75244]:     <acpi/>
Nov 29 23:25:16 user nova-compute[75244]:     <apic/>
Nov 29 23:25:16 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:25:16 user nova-compute[75244]:   </features>
Nov 29 23:25:16 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:25:16 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:25:16 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:25:16 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:25:16 user nova-compute[75244]:   </clock>
Nov 29 23:25:16 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:25:16 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:25:16 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:25:16 user nova-compute[75244]:   </cpu>
Nov 29 23:25:16 user nova-compute[75244]:   <devices>
Nov 29 23:25:16 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:25:16 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:25:16 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk"/>
Nov 29 23:25:16 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:25:16 user nova-compute[75244]:     </disk>
Nov 29 23:25:16 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:25:16 user nova-compute[75244]:       <mac address="fa:16:3e:32:6e:57"/>
Nov 29 23:25:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:25:16 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:25:16 user nova-compute[75244]:       <target dev="tapc4ec64ce-eb"/>
Nov 29 23:25:16 user nova-compute[75244]:     </interface>
Nov 29 23:25:16 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:25:16 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/console.log" append="off"/>
Nov 29 23:25:16 user nova-compute[75244]:     </serial>
Nov 29 23:25:16 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:25:16 user nova-compute[75244]:     <video>
Nov 29 23:25:16 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:25:16 user nova-compute[75244]:     </video>
Nov 29 23:25:16 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:25:16 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:25:16 user nova-compute[75244]:     </rng>
Nov 29 23:25:16 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:25:16 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:25:16 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:25:16 user nova-compute[75244]:     </memballoon>
Nov 29 23:25:16 user nova-compute[75244]:   </devices>
Nov 29 23:25:16 user nova-compute[75244]: </domain>
Nov 29 23:25:16 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-549419621',display_name='tempest-SnapshotDataIntegrityTests-server-549419621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-549419621',id=42,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTScmKtmz+BExfQzr0NW2vxfGh1tACmuiaZE87OPoBtotyd4Y8b3ZMiJhclbIuUg2fIWPPUv8OLs0m1UoY6P/H6d7qYr/aXNheBXSBCEEIzRupudi1Ll8uChjJSUpwX3w==',key_name='tempest-keypair-107456481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1b493900b974a96b519797f02ddc070',ramdisk_id='',reservation_id='r-txro7k71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1578029874',owner_user_name='tempest-SnapshotDataIntegrityTests-1578029874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3362c152fe8d4daea107df07bca933ae',uuid=de7e455f-0838-41b7-bf6d-218e5a0559ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Converting VIF {"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG os_vif [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cdf0296-ea46-55fb-aabd-18131ed6bdd6', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4ec64ce-eb, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4ec64ce-eb, col_values=(('qos', UUID('d688b412-2a31-444f-99ee-2d3d96eaddfe')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4ec64ce-eb, col_values=(('external_ids', {'iface-id': 'c4ec64ce-eb63-42c9-8a02-4a4854b6c369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:6e:57', 'vm-uuid': 'de7e455f-0838-41b7-bf6d-218e5a0559ba'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:16 user nova-compute[75244]: INFO os_vif [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb')
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:25:16 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No VIF found with MAC fa:16:3e:32:6e:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:25:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updated VIF entry in instance network info cache for port c4ec64ce-eb63-42c9-8a02-4a4854b6c369. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:25:17 user nova-compute[75244]: DEBUG nova.network.neutron [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating instance_info_cache with network_info: [{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:25:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9700aca2-8bc1-4316-a0cc-160919c6de85 req-a2cb9408-0388-4cdd-abe5-a8fcdc0d5d82 service nova] Releasing lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-da52b016-1faa-455e-9f60-dcf237db5248 req-2492a916-c6c0-48dd-b460-b0c021f67d15 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-da52b016-1faa-455e-9f60-dcf237db5248 req-2492a916-c6c0-48dd-b460-b0c021f67d15 service nova] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-da52b016-1faa-455e-9f60-dcf237db5248 req-2492a916-c6c0-48dd-b460-b0c021f67d15 service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-da52b016-1faa-455e-9f60-dcf237db5248 req-2492a916-c6c0-48dd-b460-b0c021f67d15 service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-da52b016-1faa-455e-9f60-dcf237db5248 req-2492a916-c6c0-48dd-b460-b0c021f67d15 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] No waiting events found dispatching network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:25:18 user nova-compute[75244]: WARNING nova.compute.manager [req-da52b016-1faa-455e-9f60-dcf237db5248 req-2492a916-c6c0-48dd-b460-b0c021f67d15 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received unexpected event network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 for instance with vm_state building and task_state spawning.
Nov 29 23:25:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-bb17c69d-faf6-402b-8d5e-5a684e431bf3 req-0d4447d8-7f15-452e-ac6e-8a4e89c9662e service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bb17c69d-faf6-402b-8d5e-5a684e431bf3 req-0d4447d8-7f15-452e-ac6e-8a4e89c9662e service nova] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bb17c69d-faf6-402b-8d5e-5a684e431bf3 req-0d4447d8-7f15-452e-ac6e-8a4e89c9662e service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bb17c69d-faf6-402b-8d5e-5a684e431bf3 req-0d4447d8-7f15-452e-ac6e-8a4e89c9662e service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-bb17c69d-faf6-402b-8d5e-5a684e431bf3 req-0d4447d8-7f15-452e-ac6e-8a4e89c9662e service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] No waiting events found dispatching network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:25:20 user nova-compute[75244]: WARNING nova.compute.manager [req-bb17c69d-faf6-402b-8d5e-5a684e431bf3 req-0d4447d8-7f15-452e-ac6e-8a4e89c9662e service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received unexpected event network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 for instance with vm_state building and task_state spawning.
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:25:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Instance spawned successfully.
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:25:20 user nova-compute[75244]: INFO nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 29 23:25:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:25:20 user nova-compute[75244]: INFO nova.compute.manager [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Took 6.46 seconds to build instance.
Nov 29 23:25:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f431f480-f7c5-4028-ab31-98b11648b7c5 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.567s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:43 user nova-compute[75244]: INFO nova.compute.manager [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Terminating instance
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-fa85685e-2e1f-4d95-ba48-03159453b6d4 req-92528a75-bd6f-4675-a120-93dbacc064ff service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fa85685e-2e1f-4d95-ba48-03159453b6d4 req-92528a75-bd6f-4675-a120-93dbacc064ff service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fa85685e-2e1f-4d95-ba48-03159453b6d4 req-92528a75-bd6f-4675-a120-93dbacc064ff service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fa85685e-2e1f-4d95-ba48-03159453b6d4 req-92528a75-bd6f-4675-a120-93dbacc064ff service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-fa85685e-2e1f-4d95-ba48-03159453b6d4 req-92528a75-bd6f-4675-a120-93dbacc064ff service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-fa85685e-2e1f-4d95-ba48-03159453b6d4 req-92528a75-bd6f-4675-a120-93dbacc064ff service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-unplugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Instance destroyed successfully.
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.objects.instance [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'resources' on Instance uuid 9cb9953c-e973-45b7-87d4-00a4f3e74a54 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191563974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191563974',id=24,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-65mt2o0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:13:44Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=9cb9953c-e973-45b7-87d4-00a4f3e74a54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "address": "fa:16:3e:47:3f:68", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c2ef10b-af", "ovs_interfaceid": "6c2ef10b-af71-418d-854e-fa6ddf06ecf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_vif [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c2ef10b-af, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b25cb77-74b5-411d-a06c-364cae82730b) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:43 user nova-compute[75244]: INFO os_vif [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=6c2ef10b-af71-418d-854e-fa6ddf06ecf2,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c2ef10b-af')
Nov 29 23:25:43 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUlVfgDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:25:43 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa2e7a-c368-4bf2-b4b7-3b7dcdd396a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:25:43 user nova-compute[75244]: No targets found.
Nov 29 23:25:43 user nova-compute[75244]: iSNS:
Nov 29 23:25:43 user nova-compute[75244]: No targets found.
Nov 29 23:25:43 user nova-compute[75244]: STATIC:
Nov 29 23:25:43 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:25:43 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:25:43 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:25:43 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b
Nov 29 23:25:43 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:25:43 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:25:43 user nova-compute[75244]: FIRMWARE:
Nov 29 23:25:43 user nova-compute[75244]: No targets found.
Nov 29 23:25:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:25:43 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:25:43 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b9b6d8-9203-4047-98b2-cff9c6316cc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c953fa8-4efb-4885-a0fa-c308f6c2ea63]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:25:43 user nova-compute[75244]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:25:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b (non-flash)
Nov 29 23:25:43 user nova-compute[75244]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:25:43 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8041e9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ea801-20c2-45f2-8c7e-3938256300af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6513a6cd-2668-404f-9f06-26a37e9c889f]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a64bba-830d-45d8-ac49-308ae8ed206c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:25:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f43675-1614-424d-8d0a-7dae050fea1a]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ad5467-7f78-400c-b697-c55d17dff246]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[be715130-2fcc-4a36-9062-ad60d4e89601]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260]
Nov 29 23:25:44 user nova-compute[75244]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b, portal: 172.16.0.220,3260] successful.
Nov 29 23:25:44 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa592369-87e1-4208-a285-00a92bcd9d0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f051aa-6657-4c83-ba1e-327c4a1d6479]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] <== disconnect_volume: return (326ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:25:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Deleting instance files /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54_del
Nov 29 23:25:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Deletion of /opt/stack/data/nova/instances/9cb9953c-e973-45b7-87d4-00a4f3e74a54_del complete
Nov 29 23:25:44 user nova-compute[75244]: INFO nova.compute.manager [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 23:25:44 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:25:44 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:25:44 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Took 0.45 seconds to deallocate network for instance.
Nov 29 23:25:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-1bc38eb8-47be-4dcd-9c67-2617566c0773 req-780e17fb-b411-4899-a903-3fe2bb8bcc66 service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-deleted-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-9b586dc4-03c3-423d-8a0f-2c5cc1f68195 req-8e20168a-7e82-4a6b-b94a-1f99ad47c4bd service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9b586dc4-03c3-423d-8a0f-2c5cc1f68195 req-8e20168a-7e82-4a6b-b94a-1f99ad47c4bd service nova] Acquiring lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9b586dc4-03c3-423d-8a0f-2c5cc1f68195 req-8e20168a-7e82-4a6b-b94a-1f99ad47c4bd service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9b586dc4-03c3-423d-8a0f-2c5cc1f68195 req-8e20168a-7e82-4a6b-b94a-1f99ad47c4bd service nova] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-9b586dc4-03c3-423d-8a0f-2c5cc1f68195 req-8e20168a-7e82-4a6b-b94a-1f99ad47c4bd service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] No waiting events found dispatching network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:25:45 user nova-compute[75244]: WARNING nova.compute.manager [req-9b586dc4-03c3-423d-8a0f-2c5cc1f68195 req-8e20168a-7e82-4a6b-b94a-1f99ad47c4bd service nova] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Received unexpected event network-vif-plugged-6c2ef10b-af71-418d-854e-fa6ddf06ecf2 for instance with vm_state active and task_state deleting.
Nov 29 23:25:45 user nova-compute[75244]: INFO nova.compute.manager [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: 9cb9953c-e973-45b7-87d4-00a4f3e74a54] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:45 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Deleted allocations for instance 9cb9953c-e973-45b7-87d4-00a4f3e74a54
Nov 29 23:25:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-dd164161-f507-4314-ab7c-b72d15d46eee tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "9cb9953c-e973-45b7-87d4-00a4f3e74a54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [{"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-a8d0a398-f622-4593-b24e-9be42debfa28" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:25:47 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:48 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:25:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:25:50 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8047MB free_disk=24.880115509033203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Applying migration context for instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 as it has an incoming, in-progress migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6. Migration status is finished {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 23:25:50 user nova-compute[75244]: INFO nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating resource usage from migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a8d0a398-f622-4593-b24e-9be42debfa28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance da3316cc-c58e-4d3c-af4a-75e5f6b97d75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:25:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:25:51 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:25:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:25:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:25:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:25:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:25:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:25:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:25:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:26:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-changed-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Refreshing instance network info cache due to event network-changed-8416ee13-b303-43ec-aac5-7097b5c9799b. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:26:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] Acquiring lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:26:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] Acquired lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:26:19 user nova-compute[75244]: DEBUG nova.network.neutron [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Refreshing network info cache for port 8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'flavor' on Instance uuid dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:26:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Ignoring supplied device name: /dev/vdb
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:20 user nova-compute[75244]: INFO nova.compute.manager [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Attaching volume 5bf32877-dda8-440a-9a70-75b7af1f618b to /dev/vdb
Nov 29 23:26:20 user nova-compute[75244]: DEBUG os_brick.utils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de583f4-2248-46d3-81f2-e5e6c469002e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a0792-8ffe-4d0b-b397-4aefe9019310]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e84da7-403e-4e02-b98b-5fb30ca7c23e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48d10cc-b1b9-4856-a66d-2fd77c9d9b23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:26:20 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[43358d41-f335-4237-af59-e21a9846f667]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG os_brick.utils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updating existing volume attachment record: d0bea41e-29bd-4deb-a4ea-6dbb5ad49dad {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updated VIF entry in instance network info cache for port 8416ee13-b303-43ec-aac5-7097b5c9799b. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG nova.network.neutron [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updating instance_info_cache with network_info: [{"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:26:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c3bf08f-81d2-4f89-9911-847acc61eb39 req-4e8b78cc-e68b-4d58-a5ae-9319a9e9f48a service nova] Releasing lock "refresh_cache-dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:26:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CecPgowQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:26:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:26:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:26:28 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e941a6-d8ec-4d97-a4b0-e992297ff66a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:26:28 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5844661-e439-40ac-a3e6-929dc95e1022]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b] added
Nov 29 23:26:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe5af5-de3e-4825-9c25-1c774cfce1a1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[13666d2e-01df-4e30-b15f-1e209084e5dc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CecPgowQ {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CecPgowQ" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c2ff4a-d90f-4271-bb44-f23f74f95912]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CecPgowQ'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8e7a2-eed4-409b-bc7f-da17b25bdf53]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3857c4-08ca-4430-8f38-1650968ecd53]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:26:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:26:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff0535-c83c-4c85-9bde-9379912e58ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260]
Nov 29 23:26:28 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260] successful.
Nov 29 23:26:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f5d1c-252e-4ab6-84ec-081b3eba7b0a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e87582-a0ff-4ecb-a9a7-ee19b18cb070]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:26:28 user nova-compute[75244]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b (non-flash)
Nov 29 23:26:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:26:28 user nova-compute[75244]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b (non-flash)
Nov 29 23:26:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[278c1692-cbb4-4b75-b78d-5737da8ed3eb]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:26:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CecPgowQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23363653139343265', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363653139343265', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'flavor' on Instance uuid dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:26:29 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:26:29 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:26:29 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:26:29 user nova-compute[75244]:   <serial>5bf32877-dda8-440a-9a70-75b7af1f618b</serial>
Nov 29 23:26:29 user nova-compute[75244]: </disk>
Nov 29 23:26:29 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] No VIF found with MAC fa:16:3e:59:d1:65, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:26:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77c48b6e-c01c-433c-8072-4811b5b03fdc tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.594s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Going to confirm migration 2 {{(pid=75244) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:26:31 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'info_cache' on Instance uuid 1f8fe978-77d1-43af-9ac9-db5276cf3d17 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG nova.network.neutron [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'migration_context' on Instance uuid 1f8fe978-77d1-43af-9ac9-db5276cf3d17 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG nova.objects.base [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Object Instance<1f8fe978-77d1-43af-9ac9-db5276cf3d17> lazy-loaded attributes: info_cache,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:26:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.319s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:32 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Deleted allocation for migration 88fa599d-9a6d-4a82-9e4c-a6d67470fed6
Nov 29 23:26:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b07b4e37-2a72-4f97-8352-c2e84d57ad4a tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.369s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:33 user nova-compute[75244]: INFO nova.compute.manager [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Terminating instance
Nov 29 23:26:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d40966b-5168-4950-a2ab-f892050db3d1 req-d4dbcf15-1880-4220-8449-147fb1275eca service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-vif-unplugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d40966b-5168-4950-a2ab-f892050db3d1 req-d4dbcf15-1880-4220-8449-147fb1275eca service nova] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d40966b-5168-4950-a2ab-f892050db3d1 req-d4dbcf15-1880-4220-8449-147fb1275eca service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7d40966b-5168-4950-a2ab-f892050db3d1 req-d4dbcf15-1880-4220-8449-147fb1275eca service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d40966b-5168-4950-a2ab-f892050db3d1 req-d4dbcf15-1880-4220-8449-147fb1275eca service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] No waiting events found dispatching network-vif-unplugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-7d40966b-5168-4950-a2ab-f892050db3d1 req-d4dbcf15-1880-4220-8449-147fb1275eca service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-vif-unplugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Instance destroyed successfully.
Nov 29 23:26:34 user nova-compute[75244]: DEBUG nova.objects.instance [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lazy-loading 'resources' on Instance uuid a8d0a398-f622-4593-b24e-9be42debfa28 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-326757774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-326757774',id=17,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9595b50731fc44ae85e99ded8dbbaf61',ramdisk_id='',reservation_id='r-w22nykf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:08:53Z,user_data=None,user_id='c2a16d9d8a414de4b6621acd12b89aa0',uuid=a8d0a398-f622-4593-b24e-9be42debfa28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converting VIF {"id": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "address": "fa:16:3e:e2:84:e1", "network": {"id": "e1b357ea-a9c8-4d93-83be-1b951056cf3c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2066285246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9595b50731fc44ae85e99ded8dbbaf61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b538c9-f5", "ovs_interfaceid": "e8b538c9-f565-459f-bdb5-ffeed0d2c1d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG os_vif [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b538c9-f5, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe8e5327-1248-4b1d-8801-b5b858538729) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:34 user nova-compute[75244]: INFO os_vif [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:84:e1,bridge_name='br-int',has_traffic_filtering=True,id=e8b538c9-f565-459f-bdb5-ffeed0d2c1d4,network=Network(e1b357ea-a9c8-4d93-83be-1b951056cf3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b538c9-f5')
Nov 29 23:26:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Deleting instance files /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28_del
Nov 29 23:26:34 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Deletion of /opt/stack/data/nova/instances/a8d0a398-f622-4593-b24e-9be42debfa28_del complete
Nov 29 23:26:34 user nova-compute[75244]: INFO nova.compute.manager [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 23:26:34 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:26:34 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:26:35 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:26:35 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Took 0.44 seconds to deallocate network for instance.
Nov 29 23:26:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-82e54cd3-5e83-4acc-8e55-172749379241 req-8f6c928f-4914-4b53-9953-d29a6d234bfc service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-vif-deleted-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:35 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:26:35 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:26:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:35 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Deleted allocations for instance a8d0a398-f622-4593-b24e-9be42debfa28
Nov 29 23:26:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3ee1018f-c574-48b7-9158-1d469acf336e tempest-ServerBootFromVolumeStableRescueTest-1262475948 tempest-ServerBootFromVolumeStableRescueTest-1262475948-project-member] Lock "a8d0a398-f622-4593-b24e-9be42debfa28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.678s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-94836550-843a-4904-ae2f-98fe3e309e52 req-618ad675-f376-42f1-a6da-63be486b048b service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received event network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-94836550-843a-4904-ae2f-98fe3e309e52 req-618ad675-f376-42f1-a6da-63be486b048b service nova] Acquiring lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-94836550-843a-4904-ae2f-98fe3e309e52 req-618ad675-f376-42f1-a6da-63be486b048b service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-94836550-843a-4904-ae2f-98fe3e309e52 req-618ad675-f376-42f1-a6da-63be486b048b service nova] Lock "a8d0a398-f622-4593-b24e-9be42debfa28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-94836550-843a-4904-ae2f-98fe3e309e52 req-618ad675-f376-42f1-a6da-63be486b048b service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] No waiting events found dispatching network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:36 user nova-compute[75244]: WARNING nova.compute.manager [req-94836550-843a-4904-ae2f-98fe3e309e52 req-618ad675-f376-42f1-a6da-63be486b048b service nova] [instance: a8d0a398-f622-4593-b24e-9be42debfa28] Received unexpected event network-vif-plugged-e8b538c9-f565-459f-bdb5-ffeed0d2c1d4 for instance with vm_state deleted and task_state None.
Nov 29 23:26:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:45 user nova-compute[75244]: INFO nova.compute.manager [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Terminating instance
Nov 29 23:26:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-c5ba9a7f-6062-427e-b7a9-1eb41c143cf3 req-4a61df73-7870-4b0c-bfc1-f4a535551b73 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-unplugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c5ba9a7f-6062-427e-b7a9-1eb41c143cf3 req-4a61df73-7870-4b0c-bfc1-f4a535551b73 service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c5ba9a7f-6062-427e-b7a9-1eb41c143cf3 req-4a61df73-7870-4b0c-bfc1-f4a535551b73 service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c5ba9a7f-6062-427e-b7a9-1eb41c143cf3 req-4a61df73-7870-4b0c-bfc1-f4a535551b73 service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-c5ba9a7f-6062-427e-b7a9-1eb41c143cf3 req-4a61df73-7870-4b0c-bfc1-f4a535551b73 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-unplugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:45 user nova-compute[75244]: DEBUG nova.compute.manager [req-c5ba9a7f-6062-427e-b7a9-1eb41c143cf3 req-4a61df73-7870-4b0c-bfc1-f4a535551b73 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-unplugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Instance destroyed successfully.
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lazy-loading 'resources' on Instance uuid da3316cc-c58e-4d3c-af4a-75e5f6b97d75 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1139086801',display_name='tempest-VolumesActionsTest-instance-1139086801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1139086801',id=41,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:25:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b8fa63a0b10487daf30296ce2924922',ramdisk_id='',reservation_id='r-mbyw2tsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-46289140',owner_user_name='tempest-VolumesActionsTest-46289140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:25:01Z,user_data=None,user_id='90ad1be3a2154e378d4664b44f610e5b',uuid=da3316cc-c58e-4d3c-af4a-75e5f6b97d75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converting VIF {"id": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "address": "fa:16:3e:06:f8:1f", "network": {"id": "c355b3b0-cd3a-44a4-9d85-7c2137721e59", "bridge": "br-int", "label": "tempest-VolumesActionsTest-681557939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b8fa63a0b10487daf30296ce2924922", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd4cd9c-8f", "ovs_interfaceid": "3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG os_vif [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd4cd9c-8f, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cd5de43-57f9-40a6-b4ab-ff5332d1822e) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: INFO os_vif [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f8:1f,bridge_name='br-int',has_traffic_filtering=True,id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7,network=Network(c355b3b0-cd3a-44a4-9d85-7c2137721e59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd4cd9c-8f')
Nov 29 23:26:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Deleting instance files /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75_del
Nov 29 23:26:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Deletion of /opt/stack/data/nova/instances/da3316cc-c58e-4d3c-af4a-75e5f6b97d75_del complete
Nov 29 23:26:46 user nova-compute[75244]: INFO nova.compute.manager [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 29 23:26:46 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:26:46 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Took 0.61 seconds to deallocate network for instance.
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-b4f610c8-e471-44bb-98b8-7af33b6c751f req-f2bc3a35-c836-495d-b7bf-3de1a9d16d34 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-deleted-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:46 user nova-compute[75244]: INFO nova.compute.manager [req-b4f610c8-e471-44bb-98b8-7af33b6c751f req-f2bc3a35-c836-495d-b7bf-3de1a9d16d34 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Neutron deleted interface 3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7; detaching it from the instance and deleting it from the info cache
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-b4f610c8-e471-44bb-98b8-7af33b6c751f req-f2bc3a35-c836-495d-b7bf-3de1a9d16d34 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-b4f610c8-e471-44bb-98b8-7af33b6c751f req-f2bc3a35-c836-495d-b7bf-3de1a9d16d34 service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Detach interface failed, port_id=3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7, reason: Instance da3316cc-c58e-4d3c-af4a-75e5f6b97d75 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Deleted allocations for instance da3316cc-c58e-4d3c-af4a-75e5f6b97d75
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ceda31fd-ac96-4c52-8b7d-64eb2aebe1c6 tempest-VolumesActionsTest-46289140 tempest-VolumesActionsTest-46289140-project-member] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.725s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:47 user nova-compute[75244]: WARNING nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state deleted and task_state None.
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:47 user nova-compute[75244]: WARNING nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state deleted and task_state None.
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:47 user nova-compute[75244]: WARNING nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state deleted and task_state None.
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-unplugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-unplugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:47 user nova-compute[75244]: WARNING nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-unplugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state deleted and task_state None.
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Acquiring lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] Lock "da3316cc-c58e-4d3c-af4a-75e5f6b97d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:47 user nova-compute[75244]: DEBUG nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] No waiting events found dispatching network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:26:47 user nova-compute[75244]: WARNING nova.compute.manager [req-398d23dc-915c-4a99-8c98-8d00f366cdac req-3061038f-785a-4f34-8ac5-35c56b4f5e3b service nova] [instance: da3316cc-c58e-4d3c-af4a-75e5f6b97d75] Received unexpected event network-vif-plugged-3dd4cd9c-8f4f-4047-bff9-f94f93cda4e7 for instance with vm_state deleted and task_state None.
Nov 29 23:26:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:26:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:26:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:26:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:26:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:26:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8437MB free_disk=25.031578063964844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:26:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:26:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:26:52 user nova-compute[75244]: INFO nova.compute.manager [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Detaching volume 5bf32877-dda8-440a-9a70-75b7af1f618b
Nov 29 23:26:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:26:52 user nova-compute[75244]: INFO nova.virt.block_device [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Attempting to driver detach volume 5bf32877-dda8-440a-9a70-75b7af1f618b from mountpoint /dev/vdb
Nov 29 23:26:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Attempting to detach device vdb from instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:26:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:26:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:26:52 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:26:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:26:52 user nova-compute[75244]:   <serial>5bf32877-dda8-440a-9a70-75b7af1f618b</serial>
Nov 29 23:26:52 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:26:52 user nova-compute[75244]: </disk>
Nov 29 23:26:52 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:26:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully detached device vdb from instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 from the persistent domain config.
Nov 29 23:26:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:26:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:26:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:26:52 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:26:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:26:52 user nova-compute[75244]:   <serial>5bf32877-dda8-440a-9a70-75b7af1f618b</serial>
Nov 29 23:26:52 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:26:52 user nova-compute[75244]: </disk>
Nov 29 23:26:52 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:26:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:26:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:26:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:26:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-changed-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Refreshing instance network info cache due to event network-changed-c4ec64ce-eb63-42c9-8a02-4a4854b6c369. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] Acquiring lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] Acquired lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Refreshing network info cache for port c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updated VIF entry in instance network info cache for port c4ec64ce-eb63-42c9-8a02-4a4854b6c369. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating instance_info_cache with network_info: [{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e13a64d5-643a-4f47-b3ce-31073edabe29 req-4680678b-a4fb-4269-915b-5784ef85920f service nova] Releasing lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:08 user nova-compute[75244]: INFO nova.compute.manager [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attaching volume 52301972-7ebd-4b7d-87ed-df79cc2b6240 to /dev/vdb
Nov 29 23:27:08 user nova-compute[75244]: DEBUG os_brick.utils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a42c3d-45ba-465d-844f-20b7508d0a08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c036a0d-ddc1-424f-b109-e05d3db1ebaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b34676-85db-4f54-9a10-ab56f4f53678]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ec6f4-be52-4112-a0f7-b684addf9107]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:27:08 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:27:08 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fe1cae-acbb-41e9-872b-81691e1fd9db]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG os_brick.utils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:27:08 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating existing volume attachment record: eed98455-50ad-4dd3-b215-f77625d47804 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:27:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 is timed out.
Nov 29 23:27:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully detached device vdb from instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 from the live domain config.
Nov 29 23:27:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CecPgowQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:27:13 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaef5e1-99c7-4343-8d1e-1e5f931d7c51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:27:13 user nova-compute[75244]: No targets found.
Nov 29 23:27:13 user nova-compute[75244]: iSNS:
Nov 29 23:27:13 user nova-compute[75244]: No targets found.
Nov 29 23:27:13 user nova-compute[75244]: STATIC:
Nov 29 23:27:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:27:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:13 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b
Nov 29 23:27:13 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:13 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:13 user nova-compute[75244]: FIRMWARE:
Nov 29 23:27:13 user nova-compute[75244]: No targets found.
Nov 29 23:27:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:27:13 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:27:13 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[23184934-495e-4d38-a97f-a2b5c1eead4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f526d4af-5bf7-4bdc-83c7-35a3caf00753]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:13 user nova-compute[75244]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b (non-flash)
Nov 29 23:27:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:13 user nova-compute[75244]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b (non-flash)
Nov 29 23:27:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043de710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[118fe25a-5bfd-4bb7-a57f-ce2745f06a4f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[644100e8-35a7-4efe-a4ba-69f03fa55e62]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd3a9d-b261-46cb-b910-fc513fb585f2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ec203-603f-4d4b-b022-83eea393a741]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c050274-68c8-4894-841a-8b750ecab650]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261abf1-c521-46c4-801b-c46f28fd89f4]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260]
Nov 29 23:27:13 user nova-compute[75244]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b, portal: 172.16.0.220,3260] successful.
Nov 29 23:27:13 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4890d7f3-fd97-44e1-877d-b6f4ea1561d6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== disconnect_volume: return (271ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:27:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:27:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'flavor' on Instance uuid dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b8e4a3a6-ad59-4579-8969-ed4d0df51b1e tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.721s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 24.589s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:17 user nova-compute[75244]: INFO nova.compute.manager [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Terminating instance
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFBGYdtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:27:17 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:27:17 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:27:17 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc23fe7-df14-41f6-8351-ff45b7c6d53f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:27:17 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cef3b1-43ad-4376-a118-837cd81f273a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240] added
Nov 29 23:27:17 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15101f-ad42-4c37-be08-2898beb6f0bf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a214b96-3be3-4025-9e6d-34f0b87fde2b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFBGYdtu {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFBGYdtu" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e012cc6-fe58-439f-a639-b58ab8337f59]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFBGYdtu'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45966af8-6619-4753-a7aa-a764db29fd7a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2440f1b8-07c3-4b05-aba0-f2736aa9b37d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:17 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:17 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-d64092b2-4e43-43c9-823a-15234f327a01 req-578f9fa5-8d24-41f0-a8a9-880fa7760d07 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-vif-unplugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d64092b2-4e43-43c9-823a-15234f327a01 req-578f9fa5-8d24-41f0-a8a9-880fa7760d07 service nova] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d64092b2-4e43-43c9-823a-15234f327a01 req-578f9fa5-8d24-41f0-a8a9-880fa7760d07 service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d64092b2-4e43-43c9-823a-15234f327a01 req-578f9fa5-8d24-41f0-a8a9-880fa7760d07 service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-d64092b2-4e43-43c9-823a-15234f327a01 req-578f9fa5-8d24-41f0-a8a9-880fa7760d07 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] No waiting events found dispatching network-vif-unplugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.compute.manager [req-d64092b2-4e43-43c9-823a-15234f327a01 req-578f9fa5-8d24-41f0-a8a9-880fa7760d07 service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-vif-unplugged-8416ee13-b303-43ec-aac5-7097b5c9799b for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88b198c-6581-47c9-9805-de422c895572]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260]
Nov 29 23:27:17 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260] successful.
Nov 29 23:27:17 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba311eb-96be-4962-889f-02c1d4aba0f1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25e05a8-9c00-410a-af42-450d7db7b554]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:17 user nova-compute[75244]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)
Nov 29 23:27:17 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:17 user nova-compute[75244]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)
Nov 29 23:27:17 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d45dd-d071-4a54-abb0-801789ba0dae]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFBGYdtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:27:17 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Instance destroyed successfully.
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lazy-loading 'resources' on Instance uuid dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1681440888',display_name='tempest-VolumesSnapshotTestJSON-instance-1681440888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1681440888',id=40,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBNTEJjTuyxY0p0bPhrfBNE5/8IffMCntJbR3W6ksUnu1O03IUxdzohY2rTIzHZiAhU3ULNTcDvx+fssx6hRlGqJB1OPvB8garIMLusExajhYaRrgNMRw1wWRreU1B27w==',key_name='tempest-keypair-2057952895',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='908ee37c0ad54c3db82d31b804007bad',ramdisk_id='',reservation_id='r-ebaoadic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1543690330',owner_user_name='tempest-VolumesSnapshotTestJSON-1543690330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30e7929c023f45ffa625cc695e38435d',uuid=dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converting VIF {"id": "8416ee13-b303-43ec-aac5-7097b5c9799b", "address": "fa:16:3e:59:d1:65", "network": {"id": "b2c03122-a882-4c20-b446-8af38faf4b8e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1763996914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "908ee37c0ad54c3db82d31b804007bad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8416ee13-b3", "ovs_interfaceid": "8416ee13-b303-43ec-aac5-7097b5c9799b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_vif [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8416ee13-b3, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dc4e95d-2920-4152-add0-28d2e1c47c16) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:17 user nova-compute[75244]: INFO os_vif [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:d1:65,bridge_name='br-int',has_traffic_filtering=True,id=8416ee13-b303-43ec-aac5-7097b5c9799b,network=Network(b2c03122-a882-4c20-b446-8af38faf4b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8416ee13-b3')
Nov 29 23:27:17 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CecPgowQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:27:17 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:27:17 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26436323832666362', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436323832666362', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.555s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a303b9c1-01fe-4416-bc18-7e802717b6f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:27:18 user nova-compute[75244]: No targets found.
Nov 29 23:27:18 user nova-compute[75244]: iSNS:
Nov 29 23:27:18 user nova-compute[75244]: No targets found.
Nov 29 23:27:18 user nova-compute[75244]: STATIC:
Nov 29 23:27:18 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240
Nov 29 23:27:18 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:18 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:18 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:27:18 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:18 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:18 user nova-compute[75244]: FIRMWARE:
Nov 29 23:27:18 user nova-compute[75244]: No targets found.
Nov 29 23:27:18 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:27:18 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:27:18 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf32877-dda8-440a-9a70-75b7af1f618b', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:27:18 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:27:18 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:27:18 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:27:18 user nova-compute[75244]:   <serial>52301972-7ebd-4b7d-87ed-df79cc2b6240</serial>
Nov 29 23:27:18 user nova-compute[75244]: </disk>
Nov 29 23:27:18 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361f6de-ec6c-4864-b3ef-078b3a033373]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[208ac990-f9a8-4a0e-ba59-183325a974a5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:18 user nova-compute[75244]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)
Nov 29 23:27:18 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:18 user nova-compute[75244]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)
Nov 29 23:27:18 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c1a9bd0>, {}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Disconnecting from: [] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] <== disconnect_volume: return (628ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:27:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Deleting instance files /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65_del
Nov 29 23:27:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Deletion of /opt/stack/data/nova/instances/dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65_del complete
Nov 29 23:27:18 user nova-compute[75244]: INFO nova.compute.manager [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 29 23:27:18 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:27:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No VIF found with MAC fa:16:3e:32:6e:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2786d8c8-a885-4a36-a6dc-a4e7515a0935 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.552s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-a8671346-86c0-4c14-8d97-957296445434 req-7c15bfdb-6b6d-4117-a22d-c92407cd067f service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a8671346-86c0-4c14-8d97-957296445434 req-7c15bfdb-6b6d-4117-a22d-c92407cd067f service nova] Acquiring lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a8671346-86c0-4c14-8d97-957296445434 req-7c15bfdb-6b6d-4117-a22d-c92407cd067f service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a8671346-86c0-4c14-8d97-957296445434 req-7c15bfdb-6b6d-4117-a22d-c92407cd067f service nova] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-a8671346-86c0-4c14-8d97-957296445434 req-7c15bfdb-6b6d-4117-a22d-c92407cd067f service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] No waiting events found dispatching network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:27:19 user nova-compute[75244]: WARNING nova.compute.manager [req-a8671346-86c0-4c14-8d97-957296445434 req-7c15bfdb-6b6d-4117-a22d-c92407cd067f service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received unexpected event network-vif-plugged-8416ee13-b303-43ec-aac5-7097b5c9799b for instance with vm_state active and task_state deleting.
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:19 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Took 0.89 seconds to deallocate network for instance.
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-042ebefc-d802-4a5e-a718-a607a0e667c6 req-44781652-adeb-4406-98a4-befc86dfc20c service nova] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Received event network-vif-deleted-8416ee13-b303-43ec-aac5-7097b5c9799b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:19 user nova-compute[75244]: WARNING nova.volume.cinder [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Attachment d0bea41e-29bd-4deb-a4ea-6dbb5ad49dad does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d0bea41e-29bd-4deb-a4ea-6dbb5ad49dad. (HTTP 404) (Request-ID: req-1ec1ab9f-c662-4ba7-a399-73aa4751f03a)
Nov 29 23:27:19 user nova-compute[75244]: INFO nova.compute.manager [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] [instance: dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:19 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Deleted allocations for instance dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65
Nov 29 23:27:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-40ad89b2-e790-4d4e-a128-6086d26fd24c tempest-VolumesSnapshotTestJSON-1543690330 tempest-VolumesSnapshotTestJSON-1543690330-project-member] Lock "dd5d9c0c-1f31-49d9-ad0c-eb3e5895ef65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.816s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "bad58580-6ead-4570-88e6-77275812fac2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:35 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:27:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:35 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:27:35 user nova-compute[75244]: INFO nova.compute.claims [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Claim successful on node user
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.compute.manager [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Detaching volume 52301972-7ebd-4b7d-87ed-df79cc2b6240
Nov 29 23:27:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.virt.block_device [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attempting to driver detach volume 52301972-7ebd-4b7d-87ed-df79cc2b6240 from mountpoint /dev/vdb
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Attempting to detach device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:27:36 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:27:36 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:27:36 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:27:36 user nova-compute[75244]:   <serial>52301972-7ebd-4b7d-87ed-df79cc2b6240</serial>
Nov 29 23:27:36 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:27:36 user nova-compute[75244]: </disk>
Nov 29 23:27:36 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config.
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:27:36 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:27:36 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:27:36 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:27:36 user nova-compute[75244]:   <serial>52301972-7ebd-4b7d-87ed-df79cc2b6240</serial>
Nov 29 23:27:36 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:27:36 user nova-compute[75244]: </disk>
Nov 29 23:27:36 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.076s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.compute.claims [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Claim successful on node user
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.policy [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4d9a446d0de4c2bb89a407a06c525c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4228ad537cb649008a40179bb34ad326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Creating image(s)
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:27:36 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.policy [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4d9a446d0de4c2bb89a407a06c525c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4228ad537cb649008a40179bb34ad326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:27:37 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Creating image(s)
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.231s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk 1073741824" returned: 0 in 0.096s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.253s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Successfully created port: 0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.259s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.218s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Successfully created port: 68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Cannot resize image /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Ensure instance console log exists: /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk 1073741824" returned: 0 in 0.065s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:27:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Cannot resize image /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Ensure instance console log exists: /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Successfully updated port: 0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-changed-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Refreshing instance network info cache due to event network-changed-0d732042-5c82-4211-96b1-e9e6ef4d5533. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Successfully updated port: 68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-changed-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Refreshing instance network info cache due to event network-changed-68f2f494-ae50-418e-a6d6-a369c77cac5a. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance network_info: |[{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Refreshing network info cache for port 0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Start _get_guest_xml network_info=[{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:27:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:27:38 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752411322',display_name='tempest-ServerRescueNegativeTestJSON-server-1752411322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752411322',id=43,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-z69wlmvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:27:37Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=bad58580-6ead-4570-88e6-77275812fac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'pci_devices' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:27:38 user nova-compute[75244]:   <uuid>bad58580-6ead-4570-88e6-77275812fac2</uuid>
Nov 29 23:27:38 user nova-compute[75244]:   <name>instance-0000002b</name>
Nov 29 23:27:38 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:27:38 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:27:38 user nova-compute[75244]:   <metadata>
Nov 29 23:27:38 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:27:38 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:27:38 user nova-compute[75244]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1752411322</nova:name>
Nov 29 23:27:38 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:27:38</nova:creationTime>
Nov 29 23:27:38 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:27:38 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:27:38 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:27:38 user nova-compute[75244]:       <nova:owner>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:user uuid="a4d9a446d0de4c2bb89a407a06c525c0">tempest-ServerRescueNegativeTestJSON-118232042-project-member</nova:user>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:project uuid="4228ad537cb649008a40179bb34ad326">tempest-ServerRescueNegativeTestJSON-118232042</nova:project>
Nov 29 23:27:38 user nova-compute[75244]:       </nova:owner>
Nov 29 23:27:38 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:27:38 user nova-compute[75244]:       <nova:ports>
Nov 29 23:27:38 user nova-compute[75244]:         <nova:port uuid="0d732042-5c82-4211-96b1-e9e6ef4d5533">
Nov 29 23:27:38 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:27:38 user nova-compute[75244]:         </nova:port>
Nov 29 23:27:38 user nova-compute[75244]:       </nova:ports>
Nov 29 23:27:38 user nova-compute[75244]:     </nova:instance>
Nov 29 23:27:38 user nova-compute[75244]:   </metadata>
Nov 29 23:27:38 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:27:38 user nova-compute[75244]:     <system>
Nov 29 23:27:38 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:27:38 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:27:38 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:27:38 user nova-compute[75244]:       <entry name="serial">bad58580-6ead-4570-88e6-77275812fac2</entry>
Nov 29 23:27:38 user nova-compute[75244]:       <entry name="uuid">bad58580-6ead-4570-88e6-77275812fac2</entry>
Nov 29 23:27:38 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:27:38 user nova-compute[75244]:     </system>
Nov 29 23:27:38 user nova-compute[75244]:   </sysinfo>
Nov 29 23:27:38 user nova-compute[75244]:   <os>
Nov 29 23:27:38 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:27:38 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:27:38 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:27:38 user nova-compute[75244]:   </os>
Nov 29 23:27:38 user nova-compute[75244]:   <features>
Nov 29 23:27:38 user nova-compute[75244]:     <acpi/>
Nov 29 23:27:38 user nova-compute[75244]:     <apic/>
Nov 29 23:27:38 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:27:38 user nova-compute[75244]:   </features>
Nov 29 23:27:38 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:27:38 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:27:38 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:27:38 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:27:38 user nova-compute[75244]:   </clock>
Nov 29 23:27:38 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:27:38 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:27:38 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:27:38 user nova-compute[75244]:   </cpu>
Nov 29 23:27:38 user nova-compute[75244]:   <devices>
Nov 29 23:27:38 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:27:38 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:27:38 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk"/>
Nov 29 23:27:38 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:27:38 user nova-compute[75244]:     </disk>
Nov 29 23:27:38 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:27:38 user nova-compute[75244]:       <mac address="fa:16:3e:78:fb:29"/>
Nov 29 23:27:38 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:27:38 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:27:38 user nova-compute[75244]:       <target dev="tap0d732042-5c"/>
Nov 29 23:27:38 user nova-compute[75244]:     </interface>
Nov 29 23:27:38 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:27:38 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/console.log" append="off"/>
Nov 29 23:27:38 user nova-compute[75244]:     </serial>
Nov 29 23:27:38 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:27:38 user nova-compute[75244]:     <video>
Nov 29 23:27:38 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:27:38 user nova-compute[75244]:     </video>
Nov 29 23:27:38 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:27:38 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:27:38 user nova-compute[75244]:     </rng>
Nov 29 23:27:38 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:27:38 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:27:38 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:27:38 user nova-compute[75244]:     </memballoon>
Nov 29 23:27:38 user nova-compute[75244]:   </devices>
Nov 29 23:27:38 user nova-compute[75244]: </domain>
Nov 29 23:27:38 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752411322',display_name='tempest-ServerRescueNegativeTestJSON-server-1752411322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752411322',id=43,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-z69wlmvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:27:37Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=bad58580-6ead-4570-88e6-77275812fac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG os_vif [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa496ed4-560b-5c35-a967-2cc602045f76', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d732042-5c, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d732042-5c, col_values=(('qos', UUID('d85f5f86-7cb4-4803-ab26-3ca2627ac9b8')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d732042-5c, col_values=(('external_ids', {'iface-id': '0d732042-5c82-4211-96b1-e9e6ef4d5533', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:fb:29', 'vm-uuid': 'bad58580-6ead-4570-88e6-77275812fac2'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:38 user nova-compute[75244]: INFO os_vif [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c')
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:27:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:78:fb:29, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.neutron [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance network_info: |[{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.neutron [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Refreshing network info cache for port 68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Start _get_guest_xml network_info=[{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:27:39 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:27:39 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1237813919',display_name='tempest-ServerRescueNegativeTestJSON-server-1237813919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1237813919',id=44,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-2zd13hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:27:37Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=b34184c6-175a-412b-bb6f-d951d32e5fab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.objects.instance [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'pci_devices' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:27:39 user nova-compute[75244]:   <uuid>b34184c6-175a-412b-bb6f-d951d32e5fab</uuid>
Nov 29 23:27:39 user nova-compute[75244]:   <name>instance-0000002c</name>
Nov 29 23:27:39 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:27:39 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:27:39 user nova-compute[75244]:   <metadata>
Nov 29 23:27:39 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:27:39 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:27:39 user nova-compute[75244]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1237813919</nova:name>
Nov 29 23:27:39 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:27:39</nova:creationTime>
Nov 29 23:27:39 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:27:39 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:27:39 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:27:39 user nova-compute[75244]:       <nova:owner>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:user uuid="a4d9a446d0de4c2bb89a407a06c525c0">tempest-ServerRescueNegativeTestJSON-118232042-project-member</nova:user>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:project uuid="4228ad537cb649008a40179bb34ad326">tempest-ServerRescueNegativeTestJSON-118232042</nova:project>
Nov 29 23:27:39 user nova-compute[75244]:       </nova:owner>
Nov 29 23:27:39 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:27:39 user nova-compute[75244]:       <nova:ports>
Nov 29 23:27:39 user nova-compute[75244]:         <nova:port uuid="68f2f494-ae50-418e-a6d6-a369c77cac5a">
Nov 29 23:27:39 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 23:27:39 user nova-compute[75244]:         </nova:port>
Nov 29 23:27:39 user nova-compute[75244]:       </nova:ports>
Nov 29 23:27:39 user nova-compute[75244]:     </nova:instance>
Nov 29 23:27:39 user nova-compute[75244]:   </metadata>
Nov 29 23:27:39 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:27:39 user nova-compute[75244]:     <system>
Nov 29 23:27:39 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:27:39 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:27:39 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:27:39 user nova-compute[75244]:       <entry name="serial">b34184c6-175a-412b-bb6f-d951d32e5fab</entry>
Nov 29 23:27:39 user nova-compute[75244]:       <entry name="uuid">b34184c6-175a-412b-bb6f-d951d32e5fab</entry>
Nov 29 23:27:39 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:27:39 user nova-compute[75244]:     </system>
Nov 29 23:27:39 user nova-compute[75244]:   </sysinfo>
Nov 29 23:27:39 user nova-compute[75244]:   <os>
Nov 29 23:27:39 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:27:39 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:27:39 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:27:39 user nova-compute[75244]:   </os>
Nov 29 23:27:39 user nova-compute[75244]:   <features>
Nov 29 23:27:39 user nova-compute[75244]:     <acpi/>
Nov 29 23:27:39 user nova-compute[75244]:     <apic/>
Nov 29 23:27:39 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:27:39 user nova-compute[75244]:   </features>
Nov 29 23:27:39 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:27:39 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:27:39 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:27:39 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:27:39 user nova-compute[75244]:   </clock>
Nov 29 23:27:39 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:27:39 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:27:39 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:27:39 user nova-compute[75244]:   </cpu>
Nov 29 23:27:39 user nova-compute[75244]:   <devices>
Nov 29 23:27:39 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:27:39 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:27:39 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk"/>
Nov 29 23:27:39 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:27:39 user nova-compute[75244]:     </disk>
Nov 29 23:27:39 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:27:39 user nova-compute[75244]:       <mac address="fa:16:3e:db:28:84"/>
Nov 29 23:27:39 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:27:39 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:27:39 user nova-compute[75244]:       <target dev="tap68f2f494-ae"/>
Nov 29 23:27:39 user nova-compute[75244]:     </interface>
Nov 29 23:27:39 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:27:39 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/console.log" append="off"/>
Nov 29 23:27:39 user nova-compute[75244]:     </serial>
Nov 29 23:27:39 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:27:39 user nova-compute[75244]:     <video>
Nov 29 23:27:39 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:27:39 user nova-compute[75244]:     </video>
Nov 29 23:27:39 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:27:39 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:27:39 user nova-compute[75244]:     </rng>
Nov 29 23:27:39 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:27:39 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:27:39 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:27:39 user nova-compute[75244]:     </memballoon>
Nov 29 23:27:39 user nova-compute[75244]:   </devices>
Nov 29 23:27:39 user nova-compute[75244]: </domain>
Nov 29 23:27:39 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1237813919',display_name='tempest-ServerRescueNegativeTestJSON-server-1237813919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1237813919',id=44,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-2zd13hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:27:37Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=b34184c6-175a-412b-bb6f-d951d32e5fab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG os_vif [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b16f6828-fca4-5e26-bdab-c31d9f22a451', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68f2f494-ae, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68f2f494-ae, col_values=(('qos', UUID('e6cf6e9d-479e-487e-8a8e-26f3f9330ddd')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68f2f494-ae, col_values=(('external_ids', {'iface-id': '68f2f494-ae50-418e-a6d6-a369c77cac5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:28:84', 'vm-uuid': 'b34184c6-175a-412b-bb6f-d951d32e5fab'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:39 user nova-compute[75244]: INFO os_vif [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae')
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.neutron [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updated VIF entry in instance network info cache for port 0d732042-5c82-4211-96b1-e9e6ef4d5533. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.neutron [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-cac74fba-d971-4c08-8c69-fe8af2380f6f req-090ffed7-f1db-466e-b5b7-cbb73517668b service nova] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:db:28:84, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.neutron [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updated VIF entry in instance network info cache for port 68f2f494-ae50-418e-a6d6-a369c77cac5a. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG nova.network.neutron [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4de6465c-af05-4174-b5b3-9da9634ab7d1 req-c4c12267-3d85-4fe9-a4e7-713d6f6a1e5c service nova] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-c53c759a-d2ef-408a-9179-cd3478d4b3da req-c9efb3eb-a3c3-4328-afe6-f572a267566a service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c53c759a-d2ef-408a-9179-cd3478d4b3da req-c9efb3eb-a3c3-4328-afe6-f572a267566a service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c53c759a-d2ef-408a-9179-cd3478d4b3da req-c9efb3eb-a3c3-4328-afe6-f572a267566a service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c53c759a-d2ef-408a-9179-cd3478d4b3da req-c9efb3eb-a3c3-4328-afe6-f572a267566a service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-c53c759a-d2ef-408a-9179-cd3478d4b3da req-c9efb3eb-a3c3-4328-afe6-f572a267566a service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:27:41 user nova-compute[75244]: WARNING nova.compute.manager [req-c53c759a-d2ef-408a-9179-cd3478d4b3da req-c9efb3eb-a3c3-4328-afe6-f572a267566a service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state building and task_state spawning.
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-3dd786cd-a607-4c93-b849-e3e3ba6abeb5 req-6135ce31-a3c3-42fa-aa11-3f2a1d4fc16b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3dd786cd-a607-4c93-b849-e3e3ba6abeb5 req-6135ce31-a3c3-42fa-aa11-3f2a1d4fc16b service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3dd786cd-a607-4c93-b849-e3e3ba6abeb5 req-6135ce31-a3c3-42fa-aa11-3f2a1d4fc16b service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3dd786cd-a607-4c93-b849-e3e3ba6abeb5 req-6135ce31-a3c3-42fa-aa11-3f2a1d4fc16b service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG nova.compute.manager [req-3dd786cd-a607-4c93-b849-e3e3ba6abeb5 req-6135ce31-a3c3-42fa-aa11-3f2a1d4fc16b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:27:41 user nova-compute[75244]: WARNING nova.compute.manager [req-3dd786cd-a607-4c93-b849-e3e3ba6abeb5 req-6135ce31-a3c3-42fa-aa11-3f2a1d4fc16b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state building and task_state spawning.
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-71358d9d-4754-422c-9b31-67e5875f4dc9 req-9d845ef3-3d6d-44cc-9f5b-4b88ee25eccd service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71358d9d-4754-422c-9b31-67e5875f4dc9 req-9d845ef3-3d6d-44cc-9f5b-4b88ee25eccd service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71358d9d-4754-422c-9b31-67e5875f4dc9 req-9d845ef3-3d6d-44cc-9f5b-4b88ee25eccd service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-71358d9d-4754-422c-9b31-67e5875f4dc9 req-9d845ef3-3d6d-44cc-9f5b-4b88ee25eccd service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-71358d9d-4754-422c-9b31-67e5875f4dc9 req-9d845ef3-3d6d-44cc-9f5b-4b88ee25eccd service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:27:43 user nova-compute[75244]: WARNING nova.compute.manager [req-71358d9d-4754-422c-9b31-67e5875f4dc9 req-9d845ef3-3d6d-44cc-9f5b-4b88ee25eccd service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state building and task_state spawning.
Nov 29 23:27:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-4543e249-a86c-42dd-9b5a-fb2b23d2f74b req-aa75d981-e3e0-413d-8bab-5a723c9bc698 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4543e249-a86c-42dd-9b5a-fb2b23d2f74b req-aa75d981-e3e0-413d-8bab-5a723c9bc698 service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4543e249-a86c-42dd-9b5a-fb2b23d2f74b req-aa75d981-e3e0-413d-8bab-5a723c9bc698 service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4543e249-a86c-42dd-9b5a-fb2b23d2f74b req-aa75d981-e3e0-413d-8bab-5a723c9bc698 service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-4543e249-a86c-42dd-9b5a-fb2b23d2f74b req-aa75d981-e3e0-413d-8bab-5a723c9bc698 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:27:43 user nova-compute[75244]: WARNING nova.compute.manager [req-4543e249-a86c-42dd-9b5a-fb2b23d2f74b req-aa75d981-e3e0-413d-8bab-5a723c9bc698 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state building and task_state spawning.
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:27:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance spawned successfully.
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:27:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance spawned successfully.
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:44 user nova-compute[75244]: INFO nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:27:44 user nova-compute[75244]: INFO nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 29 23:27:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:27:44 user nova-compute[75244]: INFO nova.compute.manager [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Took 8.02 seconds to build instance.
Nov 29 23:27:44 user nova-compute[75244]: INFO nova.compute.manager [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Took 8.67 seconds to build instance.
Nov 29 23:27:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-84a32425-6ef9-426a-818b-d515fd768d14 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.134s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f6f93d5b-3f56-4db7-8630-0efb80dc4b39 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "bad58580-6ead-4570-88e6-77275812fac2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.769s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:49 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:27:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:27:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:27:49 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [{"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-1f8fe978-77d1-43af-9ac9-db5276cf3d17" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:27:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8454MB free_disk=25.019676208496094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:27:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:27:53 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:27:53 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:27:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:27:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.116s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:27:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:27:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba is timed out.
Nov 29 23:27:56 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config.
Nov 29 23:27:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFBGYdtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:27:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bc18b-621a-4c99-bdb0-6b88eda3ebd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:411fc3c0-9556-4f86-a8f5-efa4f362a36b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:27:56 user nova-compute[75244]: No targets found.
Nov 29 23:27:56 user nova-compute[75244]: iSNS:
Nov 29 23:27:56 user nova-compute[75244]: No targets found.
Nov 29 23:27:56 user nova-compute[75244]: STATIC:
Nov 29 23:27:56 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:411fc3c0-9556-4f86-a8f5-efa4f362a36b
Nov 29 23:27:56 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:56 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:56 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240
Nov 29 23:27:56 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:56 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:56 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:27:56 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:27:56 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:27:56 user nova-compute[75244]: FIRMWARE:
Nov 29 23:27:56 user nova-compute[75244]: No targets found.
Nov 29 23:27:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:27:56 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:27:56 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f909b1d8-b2bc-444f-8690-1c82d02728f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:411fc3c0-9556-4f86-a8f5-efa4f362a36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[93412752-e3e0-4366-99fd-831d1da90ba8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411fc3c0-9556-4f86-a8f5-efa4f362a36b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:56 user nova-compute[75244]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)
Nov 29 23:27:56 user nova-compute[75244]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411fc3c0-9556-4f86-a8f5-efa4f362a36b (non-flash)
Nov 29 23:27:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:27:56 user nova-compute[75244]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 (non-flash)
Nov 29 23:27:56 user nova-compute[75244]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:411fc3c0-9556-4f86-a8f5-efa4f362a36b (non-flash)
Nov 29 23:27:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c2c6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ef381-66f8-4268-8a15-3b8fdd708750]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[16676c81-5f4d-4a54-8011-6b8036bad8a0]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:27:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[405f9f4f-e75b-4e0d-9bad-1e97c96dbf92]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[632dbd8b-8d98-4092-98fb-baf94f6ef561]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752473b-1189-4ec5-b3e6-43cbc8310add]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f91a1f-07f3-43b7-9de0-b32301b99e43]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260]
Nov 29 23:27:57 user nova-compute[75244]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240, portal: 172.16.0.220,3260] successful.
Nov 29 23:27:57 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52301972-7ebd-4b7d-87ed-df79cc2b6240 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b5a519-4e76-4411-94fe-3b01e015c074]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== disconnect_volume: return (351ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:27:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:27:58 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:27:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2a55ed4d-3aee-4b26-97f6-30ab3f259a0a tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:27:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:27:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:27:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:27:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:27:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:28:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:28:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:01 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:28:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:22 user nova-compute[75244]: INFO nova.compute.manager [None req-8acfdcb7-ceb2-4694-a022-dffbb1775812 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Get console output
Nov 29 23:28:22 user nova-compute[75244]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 23:28:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:31 user nova-compute[75244]: INFO nova.compute.manager [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attaching volume 4364d687-89f2-4092-b8c0-6a2ae91cc075 to /dev/vdb
Nov 29 23:28:31 user nova-compute[75244]: DEBUG os_brick.utils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ccecb-508c-48d2-8681-7d328284ba18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cedd60-332c-4e83-ac81-06d8ab1bcfcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.051s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9d980-d31c-419d-b5ca-5c8a2eddcb07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3413d5eb-6a9d-4812-a5a9-41f87bb824d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:28:31 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:28:31 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76e8784-382a-45d5-a0ad-684469ef98ad]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG os_brick.utils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:28:31 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating existing volume attachment record: 3230f8b0-3c63-49a2-b7e9-c7002c761f05 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:28:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZubaovDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:28:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:28:41 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:28:41 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f711f13-57b6-4aef-b7ae-09e164ff0454]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:28:41 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab3ad4-2945-4c66-be7b-d8784cbfaafe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075] added
Nov 29 23:28:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e994f32-4390-4961-aa53-3122e2f64bff]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[47997eec-8557-4b84-91ea-204cc4d25858]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZubaovDJ {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZubaovDJ" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b13832a-1681-4ed0-94a9-4bf0deffae9a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZubaovDJ'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[21877aaf-8a8e-4eb0-ba05-809931e41ffd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4c7c5-15df-40c1-86d3-3a1642b09817]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:28:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:28:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b54ea37-6afc-4e1b-bff3-9349aa2ee620]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260]
Nov 29 23:28:41 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260] successful.
Nov 29 23:28:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfe041a-3b58-4844-ac35-b6859bd42eb3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e830588-9900-4780-9b70-fa6d95679f21]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:28:41 user nova-compute[75244]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 (non-flash)
Nov 29 23:28:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:28:41 user nova-compute[75244]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 (non-flash)
Nov 29 23:28:41 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae8947-2e6b-4587-8cf8-2238b7abd9d7]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:28:41 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZubaovDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23662646432326632', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662646432326632', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:28:42 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:28:42 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:28:42 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:28:42 user nova-compute[75244]:   <serial>4364d687-89f2-4092-b8c0-6a2ae91cc075</serial>
Nov 29 23:28:42 user nova-compute[75244]: </disk>
Nov 29 23:28:42 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No VIF found with MAC fa:16:3e:32:6e:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid e568eb15-8140-486d-a8a9-a2b5e726ad60 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 1f8fe978-77d1-43af-9ac9-db5276cf3d17 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "bad58580-6ead-4570-88e6-77275812fac2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "bad58580-6ead-4570-88e6-77275812fac2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-4f61aa17-27da-4589-a3e6-6778ebd841dd tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.716s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.164s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:44 user nova-compute[75244]: INFO nova.compute.manager [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Detaching volume 4364d687-89f2-4092-b8c0-6a2ae91cc075
Nov 29 23:28:44 user nova-compute[75244]: INFO nova.virt.block_device [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attempting to driver detach volume 4364d687-89f2-4092-b8c0-6a2ae91cc075 from mountpoint /dev/vdb
Nov 29 23:28:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Attempting to detach device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:28:44 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:28:44 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:28:44 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:28:44 user nova-compute[75244]:   <serial>4364d687-89f2-4092-b8c0-6a2ae91cc075</serial>
Nov 29 23:28:44 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:28:44 user nova-compute[75244]: </disk>
Nov 29 23:28:44 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:28:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config.
Nov 29 23:28:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:28:44 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:28:44 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:28:44 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:28:44 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:28:44 user nova-compute[75244]:   <serial>4364d687-89f2-4092-b8c0-6a2ae91cc075</serial>
Nov 29 23:28:44 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:28:44 user nova-compute[75244]: </disk>
Nov 29 23:28:44 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:28:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:28:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:28:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:28:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:28:51 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=24.972675323486328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:28:51 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:28:52 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:28:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:28:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating instance_info_cache with network_info: [{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:28:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:28:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:29:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba is timed out.
Nov 29 23:29:05 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config.
Nov 29 23:29:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZubaovDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:29:05 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2f39f1-f289-4215-9b2e-a3ef403ccc88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:29:05 user nova-compute[75244]: No targets found.
Nov 29 23:29:05 user nova-compute[75244]: iSNS:
Nov 29 23:29:05 user nova-compute[75244]: No targets found.
Nov 29 23:29:05 user nova-compute[75244]: STATIC:
Nov 29 23:29:05 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075
Nov 29 23:29:05 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:29:05 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:29:05 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:29:05 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:29:05 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:29:05 user nova-compute[75244]: FIRMWARE:
Nov 29 23:29:05 user nova-compute[75244]: No targets found.
Nov 29 23:29:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:29:05 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:29:05 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b823f71-8e12-42e2-b553-218ed004ddfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0970f97-63c7-43de-87de-17888508869c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:29:05 user nova-compute[75244]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 (non-flash)
Nov 29 23:29:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:29:05 user nova-compute[75244]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 (non-flash)
Nov 29 23:29:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043dcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce66db1-60a8-49ca-bf5f-65d4a97c8821]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7616ced5-666a-479f-a013-bc35f2569c47]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3abf84-8e92-4cec-aa01-fb50c2da1606]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1026c8-6b48-474e-9604-32ad10b17fdc]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ea739-3bdc-4b77-8e20-b5bf5f6ebe77]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7687b35-9f4a-4394-9385-bb65b4cb5f23]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260]
Nov 29 23:29:05 user nova-compute[75244]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075, portal: 172.16.0.220,3260] successful.
Nov 29 23:29:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4364d687-89f2-4092-b8c0-6a2ae91cc075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c7aba6-2e43-4437-b616-f0f96d320c2e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== disconnect_volume: return (304ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:29:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:29:06 user nova-compute[75244]: DEBUG nova.objects.instance [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-fb4232cd-bacb-4105-8084-feb8f3100e1b tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:29:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:29:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:29:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:23 user nova-compute[75244]: INFO nova.compute.manager [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Terminating instance
Nov 29 23:29:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-065249e2-d5ab-491b-b612-5a395f78031b req-6719bd68-2a90-449a-9517-8803238c46ef service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-unplugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-065249e2-d5ab-491b-b612-5a395f78031b req-6719bd68-2a90-449a-9517-8803238c46ef service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-065249e2-d5ab-491b-b612-5a395f78031b req-6719bd68-2a90-449a-9517-8803238c46ef service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-065249e2-d5ab-491b-b612-5a395f78031b req-6719bd68-2a90-449a-9517-8803238c46ef service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-065249e2-d5ab-491b-b612-5a395f78031b req-6719bd68-2a90-449a-9517-8803238c46ef service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-unplugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:29:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-065249e2-d5ab-491b-b612-5a395f78031b req-6719bd68-2a90-449a-9517-8803238c46ef service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-unplugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:29:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Instance destroyed successfully.
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'resources' on Instance uuid 1f8fe978-77d1-43af-9ac9-db5276cf3d17 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1032111597',display_name='tempest-ServerActionsTestOtherA-server-1032111597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1032111597',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-tc1uf20t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=1f8fe978-77d1-43af-9ac9-db5276cf3d17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "address": "fa:16:3e:32:36:ae", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6730da14-0a", "ovs_interfaceid": "6730da14-0a14-4e3f-ba87-45ddc06d676a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_vif [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6730da14-0a, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08aee8a8-0af3-43f2-891e-8a67a8f8e422) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:24 user nova-compute[75244]: INFO os_vif [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:36:ae,bridge_name='br-int',has_traffic_filtering=True,id=6730da14-0a14-4e3f-ba87-45ddc06d676a,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6730da14-0a')
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fBtMoKLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:29:24 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c4b646-03b1-4951-9dca-5b934eafeb75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:29:24 user nova-compute[75244]: No targets found.
Nov 29 23:29:24 user nova-compute[75244]: iSNS:
Nov 29 23:29:24 user nova-compute[75244]: No targets found.
Nov 29 23:29:24 user nova-compute[75244]: STATIC:
Nov 29 23:29:24 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47
Nov 29 23:29:24 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:29:24 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:29:24 user nova-compute[75244]: FIRMWARE:
Nov 29 23:29:24 user nova-compute[75244]: No targets found.
Nov 29 23:29:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:29:24 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:29:24 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93b1390-ed4f-459a-82b6-588fc00341f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f2357b-d209-40e1-bd03-d2d10cef5731]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:29:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 (non-flash)
Nov 29 23:29:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a1de55-a759-467e-96e0-42085757d297]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf442d-832f-4d56-b866-94bf824e9a59]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc1f303-9886-486b-adc9-3fef005811b7]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a194cc63-b4be-4485-ba91-928347958bdf]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23365363335313834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6bc2e0a2', '/dev/disk/by-id/scsi-1SCST_BIO6bc2e0a2-3e635184c9fd04de') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[af871dbe-4a1f-459b-b5d2-80509d607cae]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[74565d95-b1ae-4ce0-956c-94d95ac4d84f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b257a-26d4-435c-af3e-4084cde6641f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260]
Nov 29 23:29:24 user nova-compute[75244]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47, portal: 172.16.0.220,3260] successful.
Nov 29 23:29:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f60ddd39-b547-401c-9455-be8a7ec55d47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[16365c7c-dabd-486d-a6a4-b4f96c83787c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] <== disconnect_volume: return (283ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:29:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Deleting instance files /opt/stack/data/nova/instances/1f8fe978-77d1-43af-9ac9-db5276cf3d17_del
Nov 29 23:29:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Deletion of /opt/stack/data/nova/instances/1f8fe978-77d1-43af-9ac9-db5276cf3d17_del complete
Nov 29 23:29:24 user nova-compute[75244]: INFO nova.compute.manager [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 23:29:24 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:29:24 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:29:25 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:29:25 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Took 0.70 seconds to deallocate network for instance.
Nov 29 23:29:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-0b7ca76f-375d-4f6d-a949-819619d3bf67 req-21f9940d-ea69-485b-9861-698496756b4b service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-deleted-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-b48f60c5-f78b-4737-91b2-b510204df514 req-357b4527-993b-4037-bb60-6cb11ee0953d service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b48f60c5-f78b-4737-91b2-b510204df514 req-357b4527-993b-4037-bb60-6cb11ee0953d service nova] Acquiring lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b48f60c5-f78b-4737-91b2-b510204df514 req-357b4527-993b-4037-bb60-6cb11ee0953d service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b48f60c5-f78b-4737-91b2-b510204df514 req-357b4527-993b-4037-bb60-6cb11ee0953d service nova] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-b48f60c5-f78b-4737-91b2-b510204df514 req-357b4527-993b-4037-bb60-6cb11ee0953d service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] No waiting events found dispatching network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:29:25 user nova-compute[75244]: WARNING nova.compute.manager [req-b48f60c5-f78b-4737-91b2-b510204df514 req-357b4527-993b-4037-bb60-6cb11ee0953d service nova] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Received unexpected event network-vif-plugged-6730da14-0a14-4e3f-ba87-45ddc06d676a for instance with vm_state active and task_state deleting.
Nov 29 23:29:26 user nova-compute[75244]: INFO nova.compute.manager [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Took 0.88 seconds to detach 1 volumes for instance.
Nov 29 23:29:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: 1f8fe978-77d1-43af-9ac9-db5276cf3d17] Deleting volume: f60ddd39-b547-401c-9455-be8a7ec55d47 {{(pid=75244) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:26 user nova-compute[75244]: INFO nova.compute.manager [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Rescuing
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:26 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Deleted allocations for instance 1f8fe978-77d1-43af-9ac9-db5276cf3d17
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ee170ae6-ca80-4901-9d8f-92fdae9426a8 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "1f8fe978-77d1-43af-9ac9-db5276cf3d17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.183s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance destroyed successfully.
Nov 29 23:29:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Attempting rescue
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75244) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:29:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Creating image(s)
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'trusted_certs' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'migration_context' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.base [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<b34184c6-175a-412b-bb6f-d951d32e5fab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Start _get_guest_xml network_info=[{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:db:28:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb216299-2134-4398-939c-137bca845056', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'resources' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.base [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<b34184c6-175a-412b-bb6f-d951d32e5fab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'numa_topology' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.base [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<b34184c6-175a-412b-bb6f-d951d32e5fab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:29:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:29:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'vcpu_model' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.base [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<b34184c6-175a-412b-bb6f-d951d32e5fab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1237813919',display_name='tempest-ServerRescueNegativeTestJSON-server-1237813919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1237813919',id=44,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-2zd13hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:27:44Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=b34184c6-175a-412b-bb6f-d951d32e5fab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:db:28:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:db:28:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'pci_devices' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.objects.base [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<b34184c6-175a-412b-bb6f-d951d32e5fab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:29:27 user nova-compute[75244]:   <uuid>b34184c6-175a-412b-bb6f-d951d32e5fab</uuid>
Nov 29 23:29:27 user nova-compute[75244]:   <name>instance-0000002c</name>
Nov 29 23:29:27 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:29:27 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:29:27 user nova-compute[75244]:   <metadata>
Nov 29 23:29:27 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:29:27 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:29:27 user nova-compute[75244]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1237813919</nova:name>
Nov 29 23:29:27 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:29:27</nova:creationTime>
Nov 29 23:29:27 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:29:27 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:29:27 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:29:27 user nova-compute[75244]:       <nova:owner>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:user uuid="a4d9a446d0de4c2bb89a407a06c525c0">tempest-ServerRescueNegativeTestJSON-118232042-project-member</nova:user>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:project uuid="4228ad537cb649008a40179bb34ad326">tempest-ServerRescueNegativeTestJSON-118232042</nova:project>
Nov 29 23:29:27 user nova-compute[75244]:       </nova:owner>
Nov 29 23:29:27 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:29:27 user nova-compute[75244]:       <nova:ports>
Nov 29 23:29:27 user nova-compute[75244]:         <nova:port uuid="68f2f494-ae50-418e-a6d6-a369c77cac5a">
Nov 29 23:29:27 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 23:29:27 user nova-compute[75244]:         </nova:port>
Nov 29 23:29:27 user nova-compute[75244]:       </nova:ports>
Nov 29 23:29:27 user nova-compute[75244]:     </nova:instance>
Nov 29 23:29:27 user nova-compute[75244]:   </metadata>
Nov 29 23:29:27 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:29:27 user nova-compute[75244]:     <system>
Nov 29 23:29:27 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:29:27 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:29:27 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:29:27 user nova-compute[75244]:       <entry name="serial">b34184c6-175a-412b-bb6f-d951d32e5fab</entry>
Nov 29 23:29:27 user nova-compute[75244]:       <entry name="uuid">b34184c6-175a-412b-bb6f-d951d32e5fab</entry>
Nov 29 23:29:27 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:29:27 user nova-compute[75244]:     </system>
Nov 29 23:29:27 user nova-compute[75244]:   </sysinfo>
Nov 29 23:29:27 user nova-compute[75244]:   <os>
Nov 29 23:29:27 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:29:27 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:29:27 user nova-compute[75244]:   </os>
Nov 29 23:29:27 user nova-compute[75244]:   <features>
Nov 29 23:29:27 user nova-compute[75244]:     <acpi/>
Nov 29 23:29:27 user nova-compute[75244]:     <apic/>
Nov 29 23:29:27 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:29:27 user nova-compute[75244]:   </features>
Nov 29 23:29:27 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:29:27 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:29:27 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:29:27 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:29:27 user nova-compute[75244]:   </clock>
Nov 29 23:29:27 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:29:27 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:29:27 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:29:27 user nova-compute[75244]:   </cpu>
Nov 29 23:29:27 user nova-compute[75244]:   <devices>
Nov 29 23:29:27 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:29:27 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:29:27 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue"/>
Nov 29 23:29:27 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:29:27 user nova-compute[75244]:     </disk>
Nov 29 23:29:27 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:29:27 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:29:27 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk"/>
Nov 29 23:29:27 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:29:27 user nova-compute[75244]:     </disk>
Nov 29 23:29:27 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:29:27 user nova-compute[75244]:       <mac address="fa:16:3e:db:28:84"/>
Nov 29 23:29:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:29:27 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:29:27 user nova-compute[75244]:       <target dev="tap68f2f494-ae"/>
Nov 29 23:29:27 user nova-compute[75244]:     </interface>
Nov 29 23:29:27 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:29:27 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/console.log" append="off"/>
Nov 29 23:29:27 user nova-compute[75244]:     </serial>
Nov 29 23:29:27 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:29:27 user nova-compute[75244]:     <video>
Nov 29 23:29:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:29:27 user nova-compute[75244]:     </video>
Nov 29 23:29:27 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:29:27 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:29:27 user nova-compute[75244]:     </rng>
Nov 29 23:29:27 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:29:27 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:29:27 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:29:27 user nova-compute[75244]:     </memballoon>
Nov 29 23:29:27 user nova-compute[75244]:   </devices>
Nov 29 23:29:27 user nova-compute[75244]: </domain>
Nov 29 23:29:27 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:29:27 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance destroyed successfully.
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:29:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:db:28:84, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-unplugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-unplugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:29:28 user nova-compute[75244]: WARNING nova.compute.manager [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-unplugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state active and task_state rescuing.
Nov 29 23:29:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:29:28 user nova-compute[75244]: WARNING nova.compute.manager [req-aa0eec71-7b97-45d3-810b-32ad26a32b92 req-908a77da-93b7-4e1a-9cee-b627abb1754f service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state active and task_state rescuing.
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:29:30 user nova-compute[75244]: WARNING nova.compute.manager [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state active and task_state rescuing.
Nov 29 23:29:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:29:30 user nova-compute[75244]: WARNING nova.compute.manager [req-18cd4b16-6aa0-4c89-84ca-6d3c8987604d req-28a7bd97-e28a-4efd-8b73-6b03b4487d1b service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state active and task_state rescuing.
Nov 29 23:29:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-da394cb2-c020-4468-8513-92f846052a27 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:29:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:37 user nova-compute[75244]: DEBUG nova.objects.instance [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:38 user nova-compute[75244]: INFO nova.compute.manager [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attaching volume bf20cf99-98ca-47e8-aed6-bdb56fa871de to /dev/vdb
Nov 29 23:29:38 user nova-compute[75244]: DEBUG os_brick.utils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3f7f0e-ecb3-4fd7-83e2-91d8aed86f85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3f288a-eb67-4841-aa2f-9c791ed96215]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e760f7e7-0864-4e0e-84e6-db4056636838]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b518d-252b-4c10-ae1a-ceb0c7c6a734]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:29:38 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:29:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85080b8-2dc1-4032-a621-59468f273e5e]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG os_brick.utils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:29:38 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating existing volume attachment record: 22b9ec07-f0ff-4c92-8527-38c1b03a2c04 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:29:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:29:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:29:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:29:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUhJHPSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:29:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:29:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:29:45 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceca037-af44-499d-b511-e0aabc329fab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:29:45 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a7aa0d-81c9-48af-9b8a-b61a12a94160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de] added
Nov 29 23:29:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4278bc59-34a8-450e-9702-8d1491ba0c9b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f1546d-03a3-4a7d-b53d-97175878e15c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUhJHPSR {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUhJHPSR" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[68003e00-846b-4fad-b721-9807fba362bb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUhJHPSR'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[af521b30-b474-4952-9230-83f45bc8d788]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6464c-1f9b-4f6c-9320-a0fccca458b4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:29:45 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:29:45 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:29:45 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:29:45 user nova-compute[75244]: 
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a621d6e-f154-41b3-b843-ddd172b816b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260]
Nov 29 23:29:45 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260] successful.
Nov 29 23:29:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de203c4-8852-4eac-a88e-47fac6f4296f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ed568-68b9-465c-92ed-c1d976813c10]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de (non-flash)
Nov 29 23:29:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de (non-flash)
Nov 29 23:29:45 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83a3d5-1f86-4b5c-998d-55079fb7f2d4]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:29:45 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUhJHPSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23430323761366336', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430323761366336', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG nova.objects.instance [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:29:46 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:29:46 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:29:46 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:29:46 user nova-compute[75244]:   <serial>bf20cf99-98ca-47e8-aed6-bdb56fa871de</serial>
Nov 29 23:29:46 user nova-compute[75244]: </disk>
Nov 29 23:29:46 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:29:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:29:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:29:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No VIF found with MAC fa:16:3e:32:6e:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:29:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0c259bc3-7f25-48d8-beb8-bce315cbbe7f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.420s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:49 user nova-compute[75244]: INFO nova.compute.manager [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Detaching volume bf20cf99-98ca-47e8-aed6-bdb56fa871de
Nov 29 23:29:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:49 user nova-compute[75244]: INFO nova.virt.block_device [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attempting to driver detach volume bf20cf99-98ca-47e8-aed6-bdb56fa871de from mountpoint /dev/vdb
Nov 29 23:29:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Attempting to detach device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:29:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:29:49 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:29:49 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:29:49 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:29:49 user nova-compute[75244]:   <serial>bf20cf99-98ca-47e8-aed6-bdb56fa871de</serial>
Nov 29 23:29:49 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:29:49 user nova-compute[75244]: </disk>
Nov 29 23:29:49 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:29:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config.
Nov 29 23:29:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:29:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:29:49 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:29:49 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:29:49 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:29:49 user nova-compute[75244]:   <serial>bf20cf99-98ca-47e8-aed6-bdb56fa871de</serial>
Nov 29 23:29:49 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:29:49 user nova-compute[75244]: </disk>
Nov 29 23:29:49 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:29:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:29:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:29:53 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=24.970340728759766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance e568eb15-8140-486d-a8a9-a2b5e726ad60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:29:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:29:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:29:54 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid e568eb15-8140-486d-a8a9-a2b5e726ad60 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [{"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-e568eb15-8140-486d-a8a9-a2b5e726ad60" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:29:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:29:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:29:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba is timed out.
Nov 29 23:30:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config.
Nov 29 23:30:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUhJHPSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:30:09 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bcae0c-94a9-4399-bf0b-b55a1fc7d5b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:30:09 user nova-compute[75244]: No targets found.
Nov 29 23:30:09 user nova-compute[75244]: iSNS:
Nov 29 23:30:09 user nova-compute[75244]: No targets found.
Nov 29 23:30:09 user nova-compute[75244]: STATIC:
Nov 29 23:30:09 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de
Nov 29 23:30:09 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:30:09 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:30:09 user nova-compute[75244]: FIRMWARE:
Nov 29 23:30:09 user nova-compute[75244]: No targets found.
Nov 29 23:30:09 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:30:09 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:30:09 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9f1bc-e033-46a0-87ef-b568b1fe1dce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d8b720-d879-4613-92ea-0db69483f7b1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de (non-flash)
Nov 29 23:30:09 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de (non-flash)
Nov 29 23:30:09 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043bf010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6d6639-d08f-46f8-b8b4-05fb8af49c08]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f7666c-8593-43de-94d5-64e92072a6bd]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba10e44-274a-4f4c-b34c-48532b7472e8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[be51a306-5107-4b7a-9c2a-2965f8305adb]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3263a45f-a2df-4b5a-be14-772f430023b3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed7bdb-5754-4b93-9ace-9695024a5a9c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260]
Nov 29 23:30:09 user nova-compute[75244]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de, portal: 172.16.0.220,3260] successful.
Nov 29 23:30:09 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20cf99-98ca-47e8-aed6-bdb56fa871de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f4248-1aae-4231-ab61-4a88868a677b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== disconnect_volume: return (285ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:30:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:30:11 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:30:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b96275bb-11c1-473d-aa69-e823f6628eb4 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.085s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:30:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:30:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:30:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:18 user nova-compute[75244]: INFO nova.compute.manager [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Terminating instance
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-24dde4b0-09e3-4359-8589-8ca46a53f720 req-69c86430-be46-4f17-bf95-05ba1f1b18ff service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-vif-unplugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-24dde4b0-09e3-4359-8589-8ca46a53f720 req-69c86430-be46-4f17-bf95-05ba1f1b18ff service nova] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-24dde4b0-09e3-4359-8589-8ca46a53f720 req-69c86430-be46-4f17-bf95-05ba1f1b18ff service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-24dde4b0-09e3-4359-8589-8ca46a53f720 req-69c86430-be46-4f17-bf95-05ba1f1b18ff service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-24dde4b0-09e3-4359-8589-8ca46a53f720 req-69c86430-be46-4f17-bf95-05ba1f1b18ff service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] No waiting events found dispatching network-vif-unplugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-24dde4b0-09e3-4359-8589-8ca46a53f720 req-69c86430-be46-4f17-bf95-05ba1f1b18ff service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-vif-unplugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:30:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Instance destroyed successfully.
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.objects.instance [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lazy-loading 'resources' on Instance uuid e568eb15-8140-486d-a8a9-a2b5e726ad60 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1584162890',display_name='tempest-ServerActionsTestOtherA-server-1584162890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1584162890',id=25,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVbYwG2NaqB5wdkHYfMYkRGabXGh8T212DpgfNCjvK6OxiW3F79WcS+8TZeeQNt1Re4ZJkewDqqrGqyvyeVRf2eBp267s3tO8GC6xzUdj9L3Rpyz2pba2FY5ESaMFiB8Q==',key_name='tempest-keypair-5513924',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f36d441ef074e09bcb59e29b03b5e77',ramdisk_id='',reservation_id='r-s6sm2i0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557642123',owner_user_name='tempest-ServerActionsTestOtherA-1557642123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6d9dd0466344edc8b9aad74fd1fe1b0',uuid=e568eb15-8140-486d-a8a9-a2b5e726ad60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converting VIF {"id": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "address": "fa:16:3e:c4:d6:45", "network": {"id": "4ed015ab-7f7b-40b7-9137-c49fe6be3df3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1099265098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f36d441ef074e09bcb59e29b03b5e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e4f9aa-f0", "ovs_interfaceid": "b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG os_vif [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7e4f9aa-f0, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a8ad7da-0734-4fe3-9606-8cb46e96ff55) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:18 user nova-compute[75244]: INFO os_vif [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d6:45,bridge_name='br-int',has_traffic_filtering=True,id=b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d,network=Network(4ed015ab-7f7b-40b7-9137-c49fe6be3df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e4f9aa-f0')
Nov 29 23:30:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Deleting instance files /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60_del
Nov 29 23:30:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Deletion of /opt/stack/data/nova/instances/e568eb15-8140-486d-a8a9-a2b5e726ad60_del complete
Nov 29 23:30:18 user nova-compute[75244]: INFO nova.compute.manager [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 29 23:30:18 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:30:18 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:30:19 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:30:19 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Took 0.49 seconds to deallocate network for instance.
Nov 29 23:30:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-1c10488a-fbaf-4a43-9857-287decf06b9b req-00195ce1-7937-46bd-a185-c7e18a93af08 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-vif-deleted-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:30:19 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:30:19 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:30:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:19 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Deleted allocations for instance e568eb15-8140-486d-a8a9-a2b5e726ad60
Nov 29 23:30:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-65eb0526-44c8-4f2e-84e7-acc2a404c8f0 tempest-ServerActionsTestOtherA-1557642123 tempest-ServerActionsTestOtherA-1557642123-project-member] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.511s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-2b7e1653-3205-4131-a54e-0f76b9669de2 req-f4cb3d32-1601-4728-8441-cf064a7e16d5 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received event network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:30:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b7e1653-3205-4131-a54e-0f76b9669de2 req-f4cb3d32-1601-4728-8441-cf064a7e16d5 service nova] Acquiring lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b7e1653-3205-4131-a54e-0f76b9669de2 req-f4cb3d32-1601-4728-8441-cf064a7e16d5 service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-2b7e1653-3205-4131-a54e-0f76b9669de2 req-f4cb3d32-1601-4728-8441-cf064a7e16d5 service nova] Lock "e568eb15-8140-486d-a8a9-a2b5e726ad60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-2b7e1653-3205-4131-a54e-0f76b9669de2 req-f4cb3d32-1601-4728-8441-cf064a7e16d5 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] No waiting events found dispatching network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:30:20 user nova-compute[75244]: WARNING nova.compute.manager [req-2b7e1653-3205-4131-a54e-0f76b9669de2 req-f4cb3d32-1601-4728-8441-cf064a7e16d5 service nova] [instance: e568eb15-8140-486d-a8a9-a2b5e726ad60] Received unexpected event network-vif-plugged-b7e4f9aa-f096-4cf6-9e63-57d0ec232f7d for instance with vm_state deleted and task_state None.
Nov 29 23:30:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:30:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:30:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:30:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:42 user nova-compute[75244]: INFO nova.compute.manager [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attaching volume f09a16d1-0902-4a85-82d8-7174b41eaad4 to /dev/vdb
Nov 29 23:30:42 user nova-compute[75244]: DEBUG os_brick.utils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf4f43-ada0-4a90-be52-1ff04d5d580e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e3980-b31b-4d1d-ae83-eed887adbb3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c75c6e-00e7-40dc-9ec1-3b11f51d608e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de0ee2-f8fe-4ab2-a29c-568f3b6d1f03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:30:42 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:30:42 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d5998-a2c3-48f7-a69b-77995a48c78f]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG os_brick.utils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:30:42 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating existing volume attachment record: 8eccde19-7b27-4111-a2df-71511cd4fdca {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:30:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTQjHWmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:30:49 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:30:49 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:30:49 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea866b68-1f30-46bd-858a-ca279d9d87fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:30:49 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d92dd-07a8-4eaa-a204-3e054f8787c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4] added
Nov 29 23:30:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb5e92-bc82-45a4-803c-38c192b5f6c1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4773f914-ef25-49d5-bf1c-56e60145f644]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTQjHWmA {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTQjHWmA" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1aa901-432d-4f41-952c-250c5169cf02]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OTQjHWmA'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67ec54e-8a5e-4f4c-84a1-49a8dc1d691f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786b2ec-ff52-4c49-8b3d-615cbba082a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:30:49 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:30:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:30:49 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:30:49 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:30:49 user nova-compute[75244]: 
Nov 29 23:30:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da27e2-1178-44b5-82de-be516bc5af6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260]
Nov 29 23:30:50 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260] successful.
Nov 29 23:30:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5149954-3354-427a-b9e0-1741bbe070a0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[405dd574-914f-4750-8493-81d5a88a7aa3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 (non-flash)
Nov 29 23:30:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 (non-flash)
Nov 29 23:30:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e2116e-dd56-4a09-9d60-828b70f84481]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:30:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTQjHWmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23534633330636133', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534633330636133', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:30:51 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:30:51 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:30:51 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:30:51 user nova-compute[75244]:   <serial>f09a16d1-0902-4a85-82d8-7174b41eaad4</serial>
Nov 29 23:30:51 user nova-compute[75244]: </disk>
Nov 29 23:30:51 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] No VIF found with MAC fa:16:3e:32:6e:57, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:30:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cefcea2e-6d20-41af-8ab5-c9d9f1c86f9c tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.319s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:30:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:53 user nova-compute[75244]: INFO nova.compute.manager [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Detaching volume f09a16d1-0902-4a85-82d8-7174b41eaad4
Nov 29 23:30:53 user nova-compute[75244]: INFO nova.virt.block_device [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Attempting to driver detach volume f09a16d1-0902-4a85-82d8-7174b41eaad4 from mountpoint /dev/vdb
Nov 29 23:30:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Attempting to detach device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:30:53 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:30:53 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:30:53 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:30:53 user nova-compute[75244]:   <serial>f09a16d1-0902-4a85-82d8-7174b41eaad4</serial>
Nov 29 23:30:53 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:30:53 user nova-compute[75244]: </disk>
Nov 29 23:30:53 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:30:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the persistent domain config.
Nov 29 23:30:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:30:53 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:30:53 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:30:53 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:30:53 user nova-compute[75244]:   <serial>f09a16d1-0902-4a85-82d8-7174b41eaad4</serial>
Nov 29 23:30:53 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:30:53 user nova-compute[75244]: </disk>
Nov 29 23:30:53 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:30:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:30:54 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:30:54 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=24.996875762939453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:30:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:30:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:30:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating instance_info_cache with network_info: [{"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-de7e455f-0838-41b7-bf6d-218e5a0559ba" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:30:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:31:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:31:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:31:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:31:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:31:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de7e455f-0838-41b7-bf6d-218e5a0559ba is timed out.
Nov 29 23:31:14 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully detached device vdb from instance de7e455f-0838-41b7-bf6d-218e5a0559ba from the live domain config.
Nov 29 23:31:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTQjHWmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:31:14 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e722f36-df0c-4a39-8c5a-7a7b324e70bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:31:14 user nova-compute[75244]: No targets found.
Nov 29 23:31:14 user nova-compute[75244]: iSNS:
Nov 29 23:31:14 user nova-compute[75244]: No targets found.
Nov 29 23:31:14 user nova-compute[75244]: STATIC:
Nov 29 23:31:14 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4
Nov 29 23:31:14 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:31:14 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:31:14 user nova-compute[75244]: FIRMWARE:
Nov 29 23:31:14 user nova-compute[75244]: No targets found.
Nov 29 23:31:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:31:14 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:31:14 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231ff10-87dd-4054-b38b-e27be1d87c85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e2cf4-6553-4c40-a0f8-a999c03592f7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 (non-flash)
Nov 29 23:31:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 (non-flash)
Nov 29 23:31:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c0f01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9027cc08-ca1e-4440-9d29-99475c9bf6e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[30785146-259b-4a24-88bf-3d8e5c7b285c]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cec8c4-8160-4f35-8f7a-f4c14ce7ae4a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d23d71-54ed-438d-9d8a-a70682f5e7bd]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662f72b-e439-4c39-8278-f8b8f2843bdf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23384be-3c24-4b5c-80eb-d5724f72406e]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260]
Nov 29 23:31:14 user nova-compute[75244]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4, portal: 172.16.0.220,3260] successful.
Nov 29 23:31:14 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f09a16d1-0902-4a85-82d8-7174b41eaad4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea3791-31d2-4a82-bb43-aa22ca0c0e01]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] <== disconnect_volume: return (283ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:31:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:31:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'flavor' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:31:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2e20bf21-40e9-4f97-ba4f-b59a569e3093 tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.930s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:31:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:31:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:31:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:31:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:31:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=24.986862182617188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance de7e455f-0838-41b7-bf6d-218e5a0559ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:31:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:31:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:31:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:31:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:31:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:32:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:32:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:32:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:32:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:32:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:32:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:32:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:32:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:32:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:32:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:17 user nova-compute[75244]: INFO nova.compute.manager [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Terminating instance
Nov 29 23:32:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-08a33ed0-f9bb-42c5-a617-2bfb5f259b06 req-54cd422d-52ea-4adc-9b8c-66016ea05924 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-vif-unplugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08a33ed0-f9bb-42c5-a617-2bfb5f259b06 req-54cd422d-52ea-4adc-9b8c-66016ea05924 service nova] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08a33ed0-f9bb-42c5-a617-2bfb5f259b06 req-54cd422d-52ea-4adc-9b8c-66016ea05924 service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-08a33ed0-f9bb-42c5-a617-2bfb5f259b06 req-54cd422d-52ea-4adc-9b8c-66016ea05924 service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-08a33ed0-f9bb-42c5-a617-2bfb5f259b06 req-54cd422d-52ea-4adc-9b8c-66016ea05924 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] No waiting events found dispatching network-vif-unplugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.compute.manager [req-08a33ed0-f9bb-42c5-a617-2bfb5f259b06 req-54cd422d-52ea-4adc-9b8c-66016ea05924 service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-vif-unplugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Instance destroyed successfully.
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.objects.instance [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lazy-loading 'resources' on Instance uuid de7e455f-0838-41b7-bf6d-218e5a0559ba {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-549419621',display_name='tempest-SnapshotDataIntegrityTests-server-549419621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-549419621',id=42,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTScmKtmz+BExfQzr0NW2vxfGh1tACmuiaZE87OPoBtotyd4Y8b3ZMiJhclbIuUg2fIWPPUv8OLs0m1UoY6P/H6d7qYr/aXNheBXSBCEEIzRupudi1Ll8uChjJSUpwX3w==',key_name='tempest-keypair-107456481',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1b493900b974a96b519797f02ddc070',ramdisk_id='',reservation_id='r-txro7k71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1578029874',owner_user_name='tempest-SnapshotDataIntegrityTests-1578029874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3362c152fe8d4daea107df07bca933ae',uuid=de7e455f-0838-41b7-bf6d-218e5a0559ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Converting VIF {"id": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "address": "fa:16:3e:32:6e:57", "network": {"id": "10e6260b-b3b5-40dc-a0ed-c45bb33765a4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1639358467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1b493900b974a96b519797f02ddc070", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4ec64ce-eb", "ovs_interfaceid": "c4ec64ce-eb63-42c9-8a02-4a4854b6c369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG os_vif [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4ec64ce-eb, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d688b412-2a31-444f-99ee-2d3d96eaddfe) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:32:18 user nova-compute[75244]: INFO os_vif [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:6e:57,bridge_name='br-int',has_traffic_filtering=True,id=c4ec64ce-eb63-42c9-8a02-4a4854b6c369,network=Network(10e6260b-b3b5-40dc-a0ed-c45bb33765a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4ec64ce-eb')
Nov 29 23:32:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Deleting instance files /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba_del
Nov 29 23:32:18 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Deletion of /opt/stack/data/nova/instances/de7e455f-0838-41b7-bf6d-218e5a0559ba_del complete
Nov 29 23:32:18 user nova-compute[75244]: INFO nova.compute.manager [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 23:32:18 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:32:18 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:32:19 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Took 0.94 seconds to deallocate network for instance.
Nov 29 23:32:19 user nova-compute[75244]: DEBUG nova.compute.manager [req-28061d59-9ef6-4e41-b2b3-90ce5637ca1e req-88da1abf-3251-4114-93f6-350638a689cd service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-vif-deleted-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:19 user nova-compute[75244]: INFO nova.compute.manager [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Rescuing
Nov 29 23:32:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:32:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:19 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Deleted allocations for instance de7e455f-0838-41b7-bf6d-218e5a0559ba
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-b49b5b09-7164-489a-8d22-c0ed5ae5d92f tempest-SnapshotDataIntegrityTests-1578029874 tempest-SnapshotDataIntegrityTests-1578029874-project-member] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-844f0365-7660-4c6f-9aa7-77bddaca2dd0 req-5a54a83b-492c-4ccf-8a78-167b3226148f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received event network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-844f0365-7660-4c6f-9aa7-77bddaca2dd0 req-5a54a83b-492c-4ccf-8a78-167b3226148f service nova] Acquiring lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-844f0365-7660-4c6f-9aa7-77bddaca2dd0 req-5a54a83b-492c-4ccf-8a78-167b3226148f service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-844f0365-7660-4c6f-9aa7-77bddaca2dd0 req-5a54a83b-492c-4ccf-8a78-167b3226148f service nova] Lock "de7e455f-0838-41b7-bf6d-218e5a0559ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-844f0365-7660-4c6f-9aa7-77bddaca2dd0 req-5a54a83b-492c-4ccf-8a78-167b3226148f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] No waiting events found dispatching network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:32:20 user nova-compute[75244]: WARNING nova.compute.manager [req-844f0365-7660-4c6f-9aa7-77bddaca2dd0 req-5a54a83b-492c-4ccf-8a78-167b3226148f service nova] [instance: de7e455f-0838-41b7-bf6d-218e5a0559ba] Received unexpected event network-vif-plugged-c4ec64ce-eb63-42c9-8a02-4a4854b6c369 for instance with vm_state deleted and task_state None.
Nov 29 23:32:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance destroyed successfully.
Nov 29 23:32:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Attempting rescue
Nov 29 23:32:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75244) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:32:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Creating image(s)
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'trusted_certs' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue" returned: 0 in 0.055s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'migration_context' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.base [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<bad58580-6ead-4570-88e6-77275812fac2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Start _get_guest_xml network_info=[{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:78:fb:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb216299-2134-4398-939c-137bca845056', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'resources' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.base [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<bad58580-6ead-4570-88e6-77275812fac2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'numa_topology' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.base [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<bad58580-6ead-4570-88e6-77275812fac2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:32:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:32:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'vcpu_model' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.base [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<bad58580-6ead-4570-88e6-77275812fac2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752411322',display_name='tempest-ServerRescueNegativeTestJSON-server-1752411322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752411322',id=43,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-z69wlmvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:27:44Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=bad58580-6ead-4570-88e6-77275812fac2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:78:fb:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:78:fb:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.instance [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'pci_devices' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.objects.base [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<bad58580-6ead-4570-88e6-77275812fac2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:32:21 user nova-compute[75244]:   <uuid>bad58580-6ead-4570-88e6-77275812fac2</uuid>
Nov 29 23:32:21 user nova-compute[75244]:   <name>instance-0000002b</name>
Nov 29 23:32:21 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:32:21 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:32:21 user nova-compute[75244]:   <metadata>
Nov 29 23:32:21 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:32:21 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:32:21 user nova-compute[75244]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1752411322</nova:name>
Nov 29 23:32:21 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:32:21</nova:creationTime>
Nov 29 23:32:21 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:32:21 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:32:21 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:32:21 user nova-compute[75244]:       <nova:owner>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:user uuid="a4d9a446d0de4c2bb89a407a06c525c0">tempest-ServerRescueNegativeTestJSON-118232042-project-member</nova:user>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:project uuid="4228ad537cb649008a40179bb34ad326">tempest-ServerRescueNegativeTestJSON-118232042</nova:project>
Nov 29 23:32:21 user nova-compute[75244]:       </nova:owner>
Nov 29 23:32:21 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:32:21 user nova-compute[75244]:       <nova:ports>
Nov 29 23:32:21 user nova-compute[75244]:         <nova:port uuid="0d732042-5c82-4211-96b1-e9e6ef4d5533">
Nov 29 23:32:21 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 23:32:21 user nova-compute[75244]:         </nova:port>
Nov 29 23:32:21 user nova-compute[75244]:       </nova:ports>
Nov 29 23:32:21 user nova-compute[75244]:     </nova:instance>
Nov 29 23:32:21 user nova-compute[75244]:   </metadata>
Nov 29 23:32:21 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:32:21 user nova-compute[75244]:     <system>
Nov 29 23:32:21 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:32:21 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:32:21 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:32:21 user nova-compute[75244]:       <entry name="serial">bad58580-6ead-4570-88e6-77275812fac2</entry>
Nov 29 23:32:21 user nova-compute[75244]:       <entry name="uuid">bad58580-6ead-4570-88e6-77275812fac2</entry>
Nov 29 23:32:21 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:32:21 user nova-compute[75244]:     </system>
Nov 29 23:32:21 user nova-compute[75244]:   </sysinfo>
Nov 29 23:32:21 user nova-compute[75244]:   <os>
Nov 29 23:32:21 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:32:21 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:32:21 user nova-compute[75244]:   </os>
Nov 29 23:32:21 user nova-compute[75244]:   <features>
Nov 29 23:32:21 user nova-compute[75244]:     <acpi/>
Nov 29 23:32:21 user nova-compute[75244]:     <apic/>
Nov 29 23:32:21 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:32:21 user nova-compute[75244]:   </features>
Nov 29 23:32:21 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:32:21 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:32:21 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:32:21 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:32:21 user nova-compute[75244]:   </clock>
Nov 29 23:32:21 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:32:21 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:32:21 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:32:21 user nova-compute[75244]:   </cpu>
Nov 29 23:32:21 user nova-compute[75244]:   <devices>
Nov 29 23:32:21 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:32:21 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:32:21 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue"/>
Nov 29 23:32:21 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:32:21 user nova-compute[75244]:     </disk>
Nov 29 23:32:21 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:32:21 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:32:21 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk"/>
Nov 29 23:32:21 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:32:21 user nova-compute[75244]:     </disk>
Nov 29 23:32:21 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:32:21 user nova-compute[75244]:       <mac address="fa:16:3e:78:fb:29"/>
Nov 29 23:32:21 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:32:21 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:32:21 user nova-compute[75244]:       <target dev="tap0d732042-5c"/>
Nov 29 23:32:21 user nova-compute[75244]:     </interface>
Nov 29 23:32:21 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:32:21 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/console.log" append="off"/>
Nov 29 23:32:21 user nova-compute[75244]:     </serial>
Nov 29 23:32:21 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:32:21 user nova-compute[75244]:     <video>
Nov 29 23:32:21 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:32:21 user nova-compute[75244]:     </video>
Nov 29 23:32:21 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:32:21 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:32:21 user nova-compute[75244]:     </rng>
Nov 29 23:32:21 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:32:21 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:32:21 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:32:21 user nova-compute[75244]:     </memballoon>
Nov 29 23:32:21 user nova-compute[75244]:   </devices>
Nov 29 23:32:21 user nova-compute[75244]: </domain>
Nov 29 23:32:21 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:32:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance destroyed successfully.
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:78:fb:29, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:32:21 user nova-compute[75244]: WARNING nova.compute.manager [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state active and task_state rescuing.
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:32:21 user nova-compute[75244]: WARNING nova.compute.manager [req-3667d16f-1448-450f-9ec7-bdab13bd07c5 req-6bf2bdae-25cf-4a36-a312-b8574d730b32 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state active and task_state rescuing.
Nov 29 23:32:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:32:23 user nova-compute[75244]: WARNING nova.compute.manager [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state active and task_state rescuing.
Nov 29 23:32:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:32:23 user nova-compute[75244]: WARNING nova.compute.manager [req-7fc2cf21-39bb-4f67-8e06-7209519de6f6 req-7ed12d70-9fcd-4ca1-b221-4b086639b08e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state active and task_state rescuing.
Nov 29 23:32:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-77267579-8a7f-4ebc-875c-cb0d91ace2dd tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:32:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:32:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:32:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:32:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.011310577392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:32:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:32:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:57 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:32:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:32:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:32:57 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:32:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:32:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:33:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:33:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:33:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:33:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:33:24 user nova-compute[75244]: INFO nova.compute.claims [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Claim successful on node user
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:33:24 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.policy [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54569fa044bd456987534905c16c10a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1d896455e84acfb927f5da7d8a7c44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:33:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:33:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Creating image(s)
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "/opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "/opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "/opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.210s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Successfully created port: b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk 1073741824" returned: 0 in 0.050s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.200s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Cannot resize image /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Ensure instance console log exists: /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Successfully updated port: b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquired lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-changed-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Refreshing instance network info cache due to event network-changed-b1ba9693-bdc3-4693-a6b5-09397244b517. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] Acquiring lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating instance_info_cache with network_info: [{"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Releasing lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Instance network_info: |[{"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] Acquired lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Refreshing network info cache for port b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Start _get_guest_xml network_info=[{"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:33:26 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:33:26 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1462285454',display_name='tempest-TestServerVolumeAttachmentScenario-server-1462285454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1462285454',id=45,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCshWOmeqwtjXKEZbwQUNud/i6yYnhw4XfrHUlSc0NmDSTQSqBsd8mtoi0tjNaUQyKG3Q3FMDhYu+oaxmGpG7SYGmsthhrbYBFW7fZ64SPJCvyGkjb77vzSmcZmw6l2/jw==',key_name='tempest-keypair-382250648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a1d896455e84acfb927f5da7d8a7c44',ramdisk_id='',reservation_id='r-1np49rrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-238326796',owner_user_name='tempest-TestServerVolumeAttachmentScenario-238326796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54569fa044bd456987534905c16c10a8',uuid=97fc4b03-4108-4bf7-8370-bf912e9fae13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Converting VIF {"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'pci_devices' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:33:26 user nova-compute[75244]:   <uuid>97fc4b03-4108-4bf7-8370-bf912e9fae13</uuid>
Nov 29 23:33:26 user nova-compute[75244]:   <name>instance-0000002d</name>
Nov 29 23:33:26 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:33:26 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:33:26 user nova-compute[75244]:   <metadata>
Nov 29 23:33:26 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:33:26 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:33:26 user nova-compute[75244]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1462285454</nova:name>
Nov 29 23:33:26 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:33:26</nova:creationTime>
Nov 29 23:33:26 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:33:26 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:33:26 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:33:26 user nova-compute[75244]:       <nova:owner>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:user uuid="54569fa044bd456987534905c16c10a8">tempest-TestServerVolumeAttachmentScenario-238326796-project-member</nova:user>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:project uuid="4a1d896455e84acfb927f5da7d8a7c44">tempest-TestServerVolumeAttachmentScenario-238326796</nova:project>
Nov 29 23:33:26 user nova-compute[75244]:       </nova:owner>
Nov 29 23:33:26 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:33:26 user nova-compute[75244]:       <nova:ports>
Nov 29 23:33:26 user nova-compute[75244]:         <nova:port uuid="b1ba9693-bdc3-4693-a6b5-09397244b517">
Nov 29 23:33:26 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 23:33:26 user nova-compute[75244]:         </nova:port>
Nov 29 23:33:26 user nova-compute[75244]:       </nova:ports>
Nov 29 23:33:26 user nova-compute[75244]:     </nova:instance>
Nov 29 23:33:26 user nova-compute[75244]:   </metadata>
Nov 29 23:33:26 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:33:26 user nova-compute[75244]:     <system>
Nov 29 23:33:26 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:33:26 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:33:26 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:33:26 user nova-compute[75244]:       <entry name="serial">97fc4b03-4108-4bf7-8370-bf912e9fae13</entry>
Nov 29 23:33:26 user nova-compute[75244]:       <entry name="uuid">97fc4b03-4108-4bf7-8370-bf912e9fae13</entry>
Nov 29 23:33:26 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:33:26 user nova-compute[75244]:     </system>
Nov 29 23:33:26 user nova-compute[75244]:   </sysinfo>
Nov 29 23:33:26 user nova-compute[75244]:   <os>
Nov 29 23:33:26 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:33:26 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:33:26 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:33:26 user nova-compute[75244]:   </os>
Nov 29 23:33:26 user nova-compute[75244]:   <features>
Nov 29 23:33:26 user nova-compute[75244]:     <acpi/>
Nov 29 23:33:26 user nova-compute[75244]:     <apic/>
Nov 29 23:33:26 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:33:26 user nova-compute[75244]:   </features>
Nov 29 23:33:26 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:33:26 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:33:26 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:33:26 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:33:26 user nova-compute[75244]:   </clock>
Nov 29 23:33:26 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:33:26 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:33:26 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:33:26 user nova-compute[75244]:   </cpu>
Nov 29 23:33:26 user nova-compute[75244]:   <devices>
Nov 29 23:33:26 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:33:26 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:33:26 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk"/>
Nov 29 23:33:26 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:33:26 user nova-compute[75244]:     </disk>
Nov 29 23:33:26 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:33:26 user nova-compute[75244]:       <mac address="fa:16:3e:33:e1:6b"/>
Nov 29 23:33:26 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:33:26 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:33:26 user nova-compute[75244]:       <target dev="tapb1ba9693-bd"/>
Nov 29 23:33:26 user nova-compute[75244]:     </interface>
Nov 29 23:33:26 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:33:26 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/console.log" append="off"/>
Nov 29 23:33:26 user nova-compute[75244]:     </serial>
Nov 29 23:33:26 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:33:26 user nova-compute[75244]:     <video>
Nov 29 23:33:26 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:33:26 user nova-compute[75244]:     </video>
Nov 29 23:33:26 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:33:26 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:33:26 user nova-compute[75244]:     </rng>
Nov 29 23:33:26 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:33:26 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:33:26 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:33:26 user nova-compute[75244]:     </memballoon>
Nov 29 23:33:26 user nova-compute[75244]:   </devices>
Nov 29 23:33:26 user nova-compute[75244]: </domain>
Nov 29 23:33:26 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1462285454',display_name='tempest-TestServerVolumeAttachmentScenario-server-1462285454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1462285454',id=45,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCshWOmeqwtjXKEZbwQUNud/i6yYnhw4XfrHUlSc0NmDSTQSqBsd8mtoi0tjNaUQyKG3Q3FMDhYu+oaxmGpG7SYGmsthhrbYBFW7fZ64SPJCvyGkjb77vzSmcZmw6l2/jw==',key_name='tempest-keypair-382250648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a1d896455e84acfb927f5da7d8a7c44',ramdisk_id='',reservation_id='r-1np49rrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-238326796',owner_user_name='tempest-TestServerVolumeAttachmentScenario-238326796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54569fa044bd456987534905c16c10a8',uuid=97fc4b03-4108-4bf7-8370-bf912e9fae13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Converting VIF {"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG os_vif [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5bc9cce-b501-58df-92c0-8ec7c0caf73a', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1ba9693-bd, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1ba9693-bd, col_values=(('qos', UUID('c6529e96-0422-42ed-85ab-c2cf99cf9667')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1ba9693-bd, col_values=(('external_ids', {'iface-id': 'b1ba9693-bdc3-4693-a6b5-09397244b517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:e1:6b', 'vm-uuid': '97fc4b03-4108-4bf7-8370-bf912e9fae13'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:26 user nova-compute[75244]: INFO os_vif [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd')
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No VIF found with MAC fa:16:3e:33:e1:6b, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updated VIF entry in instance network info cache for port b1ba9693-bdc3-4693-a6b5-09397244b517. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG nova.network.neutron [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating instance_info_cache with network_info: [{"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:33:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f3495cb2-61fd-4712-ae32-c1a182baaddb req-3adc8926-a461-40be-b092-d2739496bab7 service nova] Releasing lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:33:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-c8408c41-6d59-46a0-adf2-88104fc22d70 req-6e174a8d-37d0-409e-84ac-dd4b918c32ef service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:33:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c8408c41-6d59-46a0-adf2-88104fc22d70 req-6e174a8d-37d0-409e-84ac-dd4b918c32ef service nova] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c8408c41-6d59-46a0-adf2-88104fc22d70 req-6e174a8d-37d0-409e-84ac-dd4b918c32ef service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c8408c41-6d59-46a0-adf2-88104fc22d70 req-6e174a8d-37d0-409e-84ac-dd4b918c32ef service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-c8408c41-6d59-46a0-adf2-88104fc22d70 req-6e174a8d-37d0-409e-84ac-dd4b918c32ef service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] No waiting events found dispatching network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:33:28 user nova-compute[75244]: WARNING nova.compute.manager [req-c8408c41-6d59-46a0-adf2-88104fc22d70 req-6e174a8d-37d0-409e-84ac-dd4b918c32ef service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received unexpected event network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 for instance with vm_state building and task_state spawning.
Nov 29 23:33:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:33:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Instance spawned successfully.
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:33:29 user nova-compute[75244]: INFO nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 29 23:33:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:33:30 user nova-compute[75244]: INFO nova.compute.manager [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Took 5.53 seconds to build instance.
Nov 29 23:33:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cb3216a8-42cf-46c4-a9d5-4ac0e92380e2 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.656s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-1120cd73-3564-4b49-8be6-a248a83ed560 req-d7f7804d-9e4e-4a60-b9da-6513ebed3ece service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:33:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1120cd73-3564-4b49-8be6-a248a83ed560 req-d7f7804d-9e4e-4a60-b9da-6513ebed3ece service nova] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1120cd73-3564-4b49-8be6-a248a83ed560 req-d7f7804d-9e4e-4a60-b9da-6513ebed3ece service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1120cd73-3564-4b49-8be6-a248a83ed560 req-d7f7804d-9e4e-4a60-b9da-6513ebed3ece service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-1120cd73-3564-4b49-8be6-a248a83ed560 req-d7f7804d-9e4e-4a60-b9da-6513ebed3ece service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] No waiting events found dispatching network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:33:30 user nova-compute[75244]: WARNING nova.compute.manager [req-1120cd73-3564-4b49-8be6-a248a83ed560 req-d7f7804d-9e4e-4a60-b9da-6513ebed3ece service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received unexpected event network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 for instance with vm_state active and task_state None.
Nov 29 23:33:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:33:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:33:55 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.97942352294922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:33:55 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:33:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:34:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:34:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:34:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:34:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:10 user nova-compute[75244]: INFO nova.compute.manager [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Unrescuing
Nov 29 23:34:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:34:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:34:10 user nova-compute[75244]: DEBUG nova.network.neutron [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG nova.objects.instance [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'flavor' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-ed7c8834-f5ad-45ff-8bb2-8b8ff2a287fc req-589698ab-8476-4c50-9f4a-6f8de1eb70a4 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ed7c8834-f5ad-45ff-8bb2-8b8ff2a287fc req-589698ab-8476-4c50-9f4a-6f8de1eb70a4 service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ed7c8834-f5ad-45ff-8bb2-8b8ff2a287fc req-589698ab-8476-4c50-9f4a-6f8de1eb70a4 service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-ed7c8834-f5ad-45ff-8bb2-8b8ff2a287fc req-589698ab-8476-4c50-9f4a-6f8de1eb70a4 service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG nova.compute.manager [req-ed7c8834-f5ad-45ff-8bb2-8b8ff2a287fc req-589698ab-8476-4c50-9f4a-6f8de1eb70a4 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:34:11 user nova-compute[75244]: WARNING nova.compute.manager [req-ed7c8834-f5ad-45ff-8bb2-8b8ff2a287fc req-589698ab-8476-4c50-9f4a-6f8de1eb70a4 service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance destroyed successfully.
Nov 29 23:34:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:34:13 user nova-compute[75244]: WARNING nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:34:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:34:13 user nova-compute[75244]: WARNING nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:34:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:34:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:34:13 user nova-compute[75244]: WARNING nova.compute.manager [req-1a67daed-0161-4678-8940-f26cce71c3f4 req-15fde35e-73cd-485f-b235-acb67897d82e service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:34:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-99fe1e3a-bf02-42c9-9122-88141b79a0b4 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:34:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:34:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:34:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:34:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:34:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:34:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:34:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:34:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:34:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:34:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:34:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:34:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:34:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:34:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=24.977951049804688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:34:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:35:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:35:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:35:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:35:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-changed-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG nova.compute.manager [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Refreshing instance network info cache due to event network-changed-b1ba9693-bdc3-4693-a6b5-09397244b517. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] Acquiring lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] Acquired lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Refreshing network info cache for port b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updated VIF entry in instance network info cache for port b1ba9693-bdc3-4693-a6b5-09397244b517. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating instance_info_cache with network_info: [{"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-5fb2dc3e-2e27-4446-9f1c-4f94a69fcb69 req-4f94f363-69b9-455b-a04e-95cbbe2e87a2 service nova] Releasing lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'flavor' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:16 user nova-compute[75244]: INFO nova.compute.manager [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attaching volume 24999c3c-c828-4935-955a-21b84d21afc6 to /dev/vdb
Nov 29 23:35:16 user nova-compute[75244]: DEBUG os_brick.utils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f1f49c-16e4-4956-8b2a-927aacb66134]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b9696-e366-4211-aece-609d1fa9817f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2276314-e502-4a33-913e-58a1e03cef5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2faa8-2251-4a0d-bf53-6771dc30f883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:35:16 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:35:16 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e762c7b-96cd-402a-bf6e-810372c59b53]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG os_brick.utils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating existing volume attachment record: c54bce74-b98f-4660-85ef-f236311666c6 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCEAoJOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:35:23 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:35:23 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:35:23 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0273d54-e885-4d80-a04e-4fa499774a3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:35:23 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da9f27-8fab-47ff-9357-0b4c45b34333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6] added
Nov 29 23:35:23 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[33806277-7b58-4926-9db6-19b22f5b03aa]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29369ac-21aa-4769-b1f5-be4fdd57cd29]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:23 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCEAoJOT {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCEAoJOT" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879392d-1ff4-4927-8cbc-ab2c5a50bcee]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tCEAoJOT'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f986d-a143-40f4-9a54-e495a23c3993]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f33a07-1e5f-46b1-a2e7-a1efdabbdb33]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:35:24 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:35:24 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:35:24 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:35:24 user nova-compute[75244]: 
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b1f7e3-e231-4ddd-ac44-1442a7664129]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260]
Nov 29 23:35:24 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260] successful.
Nov 29 23:35:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1186d83-5dfe-44d4-97d9-e44624977df2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582fbe3-2cf6-4d76-ad3b-632ce0d23982]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:24 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85149ca-fc4e-4dba-bc5a-fff6e3c6430b]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:24 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCEAoJOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26534396131336338', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534396131336338', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'flavor' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:35:25 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:35:25 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:35:25 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:35:25 user nova-compute[75244]:   <serial>24999c3c-c828-4935-955a-21b84d21afc6</serial>
Nov 29 23:35:25 user nova-compute[75244]: </disk>
Nov 29 23:35:25 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No VIF found with MAC fa:16:3e:33:e1:6b, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:35:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e237d0ee-53d8-4d11-94f5-50726f629320 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.574s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG nova.objects.instance [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'flavor' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:28 user nova-compute[75244]: INFO nova.compute.manager [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attaching volume 437c68e3-9127-4218-999c-760c502c356e to /dev/vdc
Nov 29 23:35:28 user nova-compute[75244]: DEBUG os_brick.utils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae196a-9d24-44ff-80ae-6dcf6f82d8e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315bade-3908-467f-af3e-f9152a4a15f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6deca-8e4c-4ce7-925f-c74834feca16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6f84c0-cb57-49ba-82e9-36229af3f53c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:35:29 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:35:29 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3138b-a61d-4865-95aa-1d1a6f9c73d4]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG os_brick.utils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:35:29 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating existing volume attachment record: f06b5862-0d3e-40e1-ad8d-10a1e1625b7d {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:35:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnqpJCMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:35:36 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:35:36 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:35:36 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eb8187-6cf1-4f00-850e-879799c4d98c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:35:36 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce09a5c4-5534-4ff3-bb37-2f520e98539b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e] added
Nov 29 23:35:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44c2bb-7f71-4590-8d6a-7da70d545ecb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605310c-0af6-42aa-8437-9b3e4075a1ac]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnqpJCMY {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnqpJCMY" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be4475e-841b-418b-9e94-345031378baf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnqpJCMY'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0177308-1c2d-4a53-b5d7-fbbd312612be]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089ce38-3917-4900-b03d-b08d3cb9e13a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa627cc-4ca6-4191-9077-2e8c21450e66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260]
Nov 29 23:35:36 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260] successful.
Nov 29 23:35:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaca65b-2d42-455e-9015-e7d7f1ae8c32]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7e1f0-32cf-449a-ab16-12098e937601]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:36 user nova-compute[75244]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e (non-flash)
Nov 29 23:35:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:36 user nova-compute[75244]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e (non-flash)
Nov 29 23:35:36 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa00e4e-854b-460e-9151-c41b15c9ce08]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:35:36 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnqpJCMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:35:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:35:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26161383965343531', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:35:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161383965343531', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:35:37 user nova-compute[75244]: DEBUG nova.objects.instance [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'flavor' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:35:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:35:37 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:35:37 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:35:37 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:35:37 user nova-compute[75244]:   <serial>437c68e3-9127-4218-999c-760c502c356e</serial>
Nov 29 23:35:37 user nova-compute[75244]: </disk>
Nov 29 23:35:37 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] No VIF found with MAC fa:16:3e:33:e1:6b, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45066741-433a-4209-adff-84f98613ea84 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.610s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:38 user nova-compute[75244]: INFO nova.compute.manager [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Detaching volume 437c68e3-9127-4218-999c-760c502c356e
Nov 29 23:35:38 user nova-compute[75244]: INFO nova.virt.block_device [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attempting to driver detach volume 437c68e3-9127-4218-999c-760c502c356e from mountpoint /dev/vdc
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Attempting to detach device vdc from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:35:38 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:35:38 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:35:38 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:35:38 user nova-compute[75244]:   <serial>437c68e3-9127-4218-999c-760c502c356e</serial>
Nov 29 23:35:38 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 23:35:38 user nova-compute[75244]: </disk>
Nov 29 23:35:38 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:35:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Successfully detached device vdc from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the persistent domain config.
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:35:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:35:38 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:35:38 user nova-compute[75244]:   <source dev="/dev/sdc"/>
Nov 29 23:35:38 user nova-compute[75244]:   <target dev="vdc" bus="virtio"/>
Nov 29 23:35:38 user nova-compute[75244]:   <serial>437c68e3-9127-4218-999c-760c502c356e</serial>
Nov 29 23:35:38 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 23:35:38 user nova-compute[75244]: </disk>
Nov 29 23:35:38 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:35:39 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:35:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:35:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=24.968673706054688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:35:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:35:59 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 is timed out.
Nov 29 23:35:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Successfully detached device vdc from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the live domain config.
Nov 29 23:35:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnqpJCMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:35:59 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05be5d5-3d84-40bc-92fc-1d08b0e9b20d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:35:59 user nova-compute[75244]: No targets found.
Nov 29 23:35:59 user nova-compute[75244]: iSNS:
Nov 29 23:35:59 user nova-compute[75244]: No targets found.
Nov 29 23:35:59 user nova-compute[75244]: STATIC:
Nov 29 23:35:59 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e
Nov 29 23:35:59 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:35:59 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:35:59 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6
Nov 29 23:35:59 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:35:59 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:35:59 user nova-compute[75244]: FIRMWARE:
Nov 29 23:35:59 user nova-compute[75244]: No targets found.
Nov 29 23:35:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:35:59 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:35:59 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd06b2a-dc5f-4a59-b312-38932bef74ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f1db2-8e67-42e8-a92c-6fd8963ac5b6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:59 user nova-compute[75244]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e (non-flash)
Nov 29 23:35:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:35:59 user nova-compute[75244]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e (non-flash)
Nov 29 23:35:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043ed2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cc2926-d856-46ea-a323-66e778495e2d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4e1237-bf26-4de2-a3cd-1e6062d57574]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[838242cf-44cf-4554-9da8-d3591b1f1f1d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c540c1-eff7-448c-9dfd-190dd67997c7]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[233fa6df-ff2c-44ff-b750-7d8d9b849c3f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2846e039-3212-45f7-a5b9-bcb417fea050]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260]
Nov 29 23:35:59 user nova-compute[75244]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e, portal: 172.16.0.220,3260] successful.
Nov 29 23:35:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437c68e3-9127-4218-999c-760c502c356e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[188cdf2f-8f48-4d0f-ab21-d79041482544]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] <== disconnect_volume: return (320ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:35:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:36:00 user nova-compute[75244]: DEBUG nova.objects.instance [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'flavor' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:36:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-ba2080f3-ded3-4379-9d7a-6c0e75d47010 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:01 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating instance_info_cache with network_info: [{"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-97fc4b03-4108-4bf7-8370-bf912e9fae13" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:36:06 user nova-compute[75244]: INFO nova.compute.claims [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Claim successful on node user
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:36:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.policy [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4d9a446d0de4c2bb89a407a06c525c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4228ad537cb649008a40179bb34ad326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:36:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Creating image(s)
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk 1073741824" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.167s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Checking if we can resize image /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Cannot resize image /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Ensure instance console log exists: /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Successfully created port: 1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Successfully updated port: 1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing instance network info cache due to event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance network_info: |[{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.neutron [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Start _get_guest_xml network_info=[{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:36:08 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:36:08 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187135369',display_name='tempest-ServerRescueNegativeTestJSON-server-187135369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187135369',id=46,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLANfbqNTBPktn6TB4m7fDoKQj2v9k5wxf1b+7Xq9Yjj7ux2FEJTIVAU8bzGg/Ws8d+bekmNCs/arZydrciVjekgGo9V3ISfigZf8MX77dvbCjgN/exaigKGbweRtjCEOA==',key_name='tempest-keypair-1064301684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-jfc3zhe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=725b4714-75a3-4278-a5f7-d132e3d44769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.objects.instance [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'pci_devices' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:36:08 user nova-compute[75244]:   <uuid>725b4714-75a3-4278-a5f7-d132e3d44769</uuid>
Nov 29 23:36:08 user nova-compute[75244]:   <name>instance-0000002e</name>
Nov 29 23:36:08 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:36:08 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:36:08 user nova-compute[75244]:   <metadata>
Nov 29 23:36:08 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:36:08 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:36:08 user nova-compute[75244]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-187135369</nova:name>
Nov 29 23:36:08 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:36:08</nova:creationTime>
Nov 29 23:36:08 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:36:08 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:36:08 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:36:08 user nova-compute[75244]:       <nova:owner>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:user uuid="a4d9a446d0de4c2bb89a407a06c525c0">tempest-ServerRescueNegativeTestJSON-118232042-project-member</nova:user>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:project uuid="4228ad537cb649008a40179bb34ad326">tempest-ServerRescueNegativeTestJSON-118232042</nova:project>
Nov 29 23:36:08 user nova-compute[75244]:       </nova:owner>
Nov 29 23:36:08 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:36:08 user nova-compute[75244]:       <nova:ports>
Nov 29 23:36:08 user nova-compute[75244]:         <nova:port uuid="1ac39750-7229-4983-b7e3-a6ca2c301cc7">
Nov 29 23:36:08 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 23:36:08 user nova-compute[75244]:         </nova:port>
Nov 29 23:36:08 user nova-compute[75244]:       </nova:ports>
Nov 29 23:36:08 user nova-compute[75244]:     </nova:instance>
Nov 29 23:36:08 user nova-compute[75244]:   </metadata>
Nov 29 23:36:08 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:36:08 user nova-compute[75244]:     <system>
Nov 29 23:36:08 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:36:08 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:36:08 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:36:08 user nova-compute[75244]:       <entry name="serial">725b4714-75a3-4278-a5f7-d132e3d44769</entry>
Nov 29 23:36:08 user nova-compute[75244]:       <entry name="uuid">725b4714-75a3-4278-a5f7-d132e3d44769</entry>
Nov 29 23:36:08 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:36:08 user nova-compute[75244]:     </system>
Nov 29 23:36:08 user nova-compute[75244]:   </sysinfo>
Nov 29 23:36:08 user nova-compute[75244]:   <os>
Nov 29 23:36:08 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:36:08 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:36:08 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:36:08 user nova-compute[75244]:   </os>
Nov 29 23:36:08 user nova-compute[75244]:   <features>
Nov 29 23:36:08 user nova-compute[75244]:     <acpi/>
Nov 29 23:36:08 user nova-compute[75244]:     <apic/>
Nov 29 23:36:08 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:36:08 user nova-compute[75244]:   </features>
Nov 29 23:36:08 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:36:08 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:36:08 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:36:08 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:36:08 user nova-compute[75244]:   </clock>
Nov 29 23:36:08 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:36:08 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:36:08 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:36:08 user nova-compute[75244]:   </cpu>
Nov 29 23:36:08 user nova-compute[75244]:   <devices>
Nov 29 23:36:08 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:36:08 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:36:08 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk"/>
Nov 29 23:36:08 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:36:08 user nova-compute[75244]:     </disk>
Nov 29 23:36:08 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:36:08 user nova-compute[75244]:       <mac address="fa:16:3e:28:ef:22"/>
Nov 29 23:36:08 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:36:08 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:36:08 user nova-compute[75244]:       <target dev="tap1ac39750-72"/>
Nov 29 23:36:08 user nova-compute[75244]:     </interface>
Nov 29 23:36:08 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:36:08 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/console.log" append="off"/>
Nov 29 23:36:08 user nova-compute[75244]:     </serial>
Nov 29 23:36:08 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:36:08 user nova-compute[75244]:     <video>
Nov 29 23:36:08 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:36:08 user nova-compute[75244]:     </video>
Nov 29 23:36:08 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:36:08 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:36:08 user nova-compute[75244]:     </rng>
Nov 29 23:36:08 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:36:08 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:36:08 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:36:08 user nova-compute[75244]:     </memballoon>
Nov 29 23:36:08 user nova-compute[75244]:   </devices>
Nov 29 23:36:08 user nova-compute[75244]: </domain>
Nov 29 23:36:08 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187135369',display_name='tempest-ServerRescueNegativeTestJSON-server-187135369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187135369',id=46,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLANfbqNTBPktn6TB4m7fDoKQj2v9k5wxf1b+7Xq9Yjj7ux2FEJTIVAU8bzGg/Ws8d+bekmNCs/arZydrciVjekgGo9V3ISfigZf8MX77dvbCjgN/exaigKGbweRtjCEOA==',key_name='tempest-keypair-1064301684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-jfc3zhe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=725b4714-75a3-4278-a5f7-d132e3d44769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG os_vif [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3464289b-ec3f-5b76-8be8-09a527368b31', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ac39750-72, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ac39750-72, col_values=(('qos', UUID('417297d9-77cb-4789-b9c7-e89b806367db')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ac39750-72, col_values=(('external_ids', {'iface-id': '1ac39750-7229-4983-b7e3-a6ca2c301cc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ef:22', 'vm-uuid': '725b4714-75a3-4278-a5f7-d132e3d44769'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:08 user nova-compute[75244]: INFO os_vif [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72')
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:36:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:28:ef:22, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:36:09 user nova-compute[75244]: DEBUG nova.network.neutron [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updated VIF entry in instance network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:36:09 user nova-compute[75244]: DEBUG nova.network.neutron [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:36:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e18644ad-743d-4db3-97bd-ca7c72d31503 req-fbc436c0-c909-4ae4-bc0b-4d00857eda84 service nova] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:36:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-d76bb91f-aeba-417e-9bf5-74c0c8b02bf0 req-6cddc00c-df44-4bc8-b9fd-05205ad27777 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d76bb91f-aeba-417e-9bf5-74c0c8b02bf0 req-6cddc00c-df44-4bc8-b9fd-05205ad27777 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d76bb91f-aeba-417e-9bf5-74c0c8b02bf0 req-6cddc00c-df44-4bc8-b9fd-05205ad27777 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d76bb91f-aeba-417e-9bf5-74c0c8b02bf0 req-6cddc00c-df44-4bc8-b9fd-05205ad27777 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-d76bb91f-aeba-417e-9bf5-74c0c8b02bf0 req-6cddc00c-df44-4bc8-b9fd-05205ad27777 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:36:10 user nova-compute[75244]: WARNING nova.compute.manager [req-d76bb91f-aeba-417e-9bf5-74c0c8b02bf0 req-6cddc00c-df44-4bc8-b9fd-05205ad27777 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state building and task_state spawning.
Nov 29 23:36:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:36:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance spawned successfully.
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:36:12 user nova-compute[75244]: INFO nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:36:12 user nova-compute[75244]: INFO nova.compute.manager [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Took 6.14 seconds to build instance.
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f80af31-cf26-44ad-a8a8-0f65afbe4d73 req-5828871c-28d3-4b94-aa9d-fd40e9ccfbe6 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f80af31-cf26-44ad-a8a8-0f65afbe4d73 req-5828871c-28d3-4b94-aa9d-fd40e9ccfbe6 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f80af31-cf26-44ad-a8a8-0f65afbe4d73 req-5828871c-28d3-4b94-aa9d-fd40e9ccfbe6 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4f80af31-cf26-44ad-a8a8-0f65afbe4d73 req-5828871c-28d3-4b94-aa9d-fd40e9ccfbe6 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-4f80af31-cf26-44ad-a8a8-0f65afbe4d73 req-5828871c-28d3-4b94-aa9d-fd40e9ccfbe6 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:36:12 user nova-compute[75244]: WARNING nova.compute.manager [req-4f80af31-cf26-44ad-a8a8-0f65afbe4d73 req-5828871c-28d3-4b94-aa9d-fd40e9ccfbe6 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state active and task_state None.
Nov 29 23:36:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-93e576bc-900d-4e9b-a5c2-5bb919ca5127 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.233s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:36:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:36:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:36:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:36:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:36:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:29 user nova-compute[75244]: INFO nova.compute.manager [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Detaching volume 24999c3c-c828-4935-955a-21b84d21afc6
Nov 29 23:36:29 user nova-compute[75244]: INFO nova.virt.block_device [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Attempting to driver detach volume 24999c3c-c828-4935-955a-21b84d21afc6 from mountpoint /dev/vdb
Nov 29 23:36:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Attempting to detach device vdb from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:36:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:36:29 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:36:29 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:36:29 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:36:29 user nova-compute[75244]:   <serial>24999c3c-c828-4935-955a-21b84d21afc6</serial>
Nov 29 23:36:29 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:36:29 user nova-compute[75244]: </disk>
Nov 29 23:36:29 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:36:29 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Successfully detached device vdb from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the persistent domain config.
Nov 29 23:36:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:36:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:36:29 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:36:29 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:36:29 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:36:29 user nova-compute[75244]:   <serial>24999c3c-c828-4935-955a-21b84d21afc6</serial>
Nov 29 23:36:29 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:36:29 user nova-compute[75244]: </disk>
Nov 29 23:36:29 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:36:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:36:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:36:49 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 is timed out.
Nov 29 23:36:49 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Successfully detached device vdb from instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 from the live domain config.
Nov 29 23:36:49 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCEAoJOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:36:49 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50c1b6-d750-4a24-af10-0ea6217a5fcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:36:49 user nova-compute[75244]: No targets found.
Nov 29 23:36:49 user nova-compute[75244]: iSNS:
Nov 29 23:36:49 user nova-compute[75244]: No targets found.
Nov 29 23:36:49 user nova-compute[75244]: STATIC:
Nov 29 23:36:49 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6
Nov 29 23:36:49 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:36:49 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:36:49 user nova-compute[75244]: FIRMWARE:
Nov 29 23:36:49 user nova-compute[75244]: No targets found.
Nov 29 23:36:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:36:49 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:36:49 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd6df0-7648-4ced-9a83-8d68c82cc662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aab354-4dc3-4a88-bd17-6081c9dd7492]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:36:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 (non-flash)
Nov 29 23:36:49 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c264820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aab709c-d573-40ed-ae92-0fecdabb6956]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a345d9e-29e0-4299-95b4-1a40d28fb1ea]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:36:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a485e66-6779-47f9-8690-b8cee63df679]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2fd4cb-b4f2-4d44-b558-d07cf847b899]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaad37b-ca01-4a83-bbc3-4674d37b76cd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b73a75-f6bf-4acf-8a5c-41d2c5e2283e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260]
Nov 29 23:36:50 user nova-compute[75244]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6, portal: 172.16.0.220,3260] successful.
Nov 29 23:36:50 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24999c3c-c828-4935-955a-21b84d21afc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c519a41-2b39-4499-b1ba-fd03ce7a8557]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] <== disconnect_volume: return (275ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG nova.objects.instance [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'flavor' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:36:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-d12c4bd0-6716-414e-813d-7c1b55c8609a tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:36:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:36:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:36:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:36:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:54 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:36:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:36:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=24.938823699951172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 97fc4b03-4108-4bf7-8370-bf912e9fae13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:36:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:36:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:37:04 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:37:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:37:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:37:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:37:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:37:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:19 user nova-compute[75244]: INFO nova.compute.manager [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Terminating instance
Nov 29 23:37:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-8f3edc30-afec-4e77-b2bb-5e74e76c472d req-210f0de0-7e5d-4031-9a98-210036690f96 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-vif-unplugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8f3edc30-afec-4e77-b2bb-5e74e76c472d req-210f0de0-7e5d-4031-9a98-210036690f96 service nova] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8f3edc30-afec-4e77-b2bb-5e74e76c472d req-210f0de0-7e5d-4031-9a98-210036690f96 service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8f3edc30-afec-4e77-b2bb-5e74e76c472d req-210f0de0-7e5d-4031-9a98-210036690f96 service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-8f3edc30-afec-4e77-b2bb-5e74e76c472d req-210f0de0-7e5d-4031-9a98-210036690f96 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] No waiting events found dispatching network-vif-unplugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.compute.manager [req-8f3edc30-afec-4e77-b2bb-5e74e76c472d req-210f0de0-7e5d-4031-9a98-210036690f96 service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-vif-unplugged-b1ba9693-bdc3-4693-a6b5-09397244b517 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Instance destroyed successfully.
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lazy-loading 'resources' on Instance uuid 97fc4b03-4108-4bf7-8370-bf912e9fae13 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1462285454',display_name='tempest-TestServerVolumeAttachmentScenario-server-1462285454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1462285454',id=45,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCshWOmeqwtjXKEZbwQUNud/i6yYnhw4XfrHUlSc0NmDSTQSqBsd8mtoi0tjNaUQyKG3Q3FMDhYu+oaxmGpG7SYGmsthhrbYBFW7fZ64SPJCvyGkjb77vzSmcZmw6l2/jw==',key_name='tempest-keypair-382250648',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:33:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a1d896455e84acfb927f5da7d8a7c44',ramdisk_id='',reservation_id='r-1np49rrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-238326796',owner_user_name='tempest-TestServerVolumeAttachmentScenario-238326796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54569fa044bd456987534905c16c10a8',uuid=97fc4b03-4108-4bf7-8370-bf912e9fae13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Converting VIF {"id": "b1ba9693-bdc3-4693-a6b5-09397244b517", "address": "fa:16:3e:33:e1:6b", "network": {"id": "81ef911b-34f0-463f-a4f5-d8acd5b53bcd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1889275810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a1d896455e84acfb927f5da7d8a7c44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ba9693-bd", "ovs_interfaceid": "b1ba9693-bdc3-4693-a6b5-09397244b517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG os_vif [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1ba9693-bd, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6529e96-0422-42ed-85ab-c2cf99cf9667) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:20 user nova-compute[75244]: INFO os_vif [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:e1:6b,bridge_name='br-int',has_traffic_filtering=True,id=b1ba9693-bdc3-4693-a6b5-09397244b517,network=Network(81ef911b-34f0-463f-a4f5-d8acd5b53bcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ba9693-bd')
Nov 29 23:37:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Deleting instance files /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13_del
Nov 29 23:37:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Deletion of /opt/stack/data/nova/instances/97fc4b03-4108-4bf7-8370-bf912e9fae13_del complete
Nov 29 23:37:20 user nova-compute[75244]: INFO nova.compute.manager [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 23:37:20 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:37:20 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:37:21 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:37:21 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Took 0.88 seconds to deallocate network for instance.
Nov 29 23:37:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:21 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:37:21 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:37:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:21 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Deleted allocations for instance 97fc4b03-4108-4bf7-8370-bf912e9fae13
Nov 29 23:37:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5575753b-741b-4f47-87a8-51e99c0717d1 tempest-TestServerVolumeAttachmentScenario-238326796 tempest-TestServerVolumeAttachmentScenario-238326796-project-member] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:37:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] Acquiring lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] Lock "97fc4b03-4108-4bf7-8370-bf912e9fae13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] No waiting events found dispatching network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:37:22 user nova-compute[75244]: WARNING nova.compute.manager [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received unexpected event network-vif-plugged-b1ba9693-bdc3-4693-a6b5-09397244b517 for instance with vm_state deleted and task_state None.
Nov 29 23:37:22 user nova-compute[75244]: DEBUG nova.compute.manager [req-12d2814e-5363-4586-944c-1abe8514ff89 req-5a5a45ec-e2d1-456b-ad1c-92f91b72c2fe service nova] [instance: 97fc4b03-4108-4bf7-8370-bf912e9fae13] Received event network-vif-deleted-b1ba9693-bdc3-4693-a6b5-09397244b517 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:37:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Verify base images {{(pid=75244) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Image id bb216299-2134-4398-939c-137bca845056 yields fingerprint 48cf2b6ea4724f5dea2150601674071272f2e3c1 {{(pid=75244) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 23:37:29 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] image bb216299-2134-4398-939c-137bca845056 at (/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1): checking
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] image bb216299-2134-4398-939c-137bca845056 at (/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1): image is in use {{(pid=75244) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75244) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] 725b4714-75a3-4278-a5f7-d132e3d44769 is a valid instance name {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] 725b4714-75a3-4278-a5f7-d132e3d44769 has a disk file {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 is backed by 48cf2b6ea4724f5dea2150601674071272f2e3c1 {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] b34184c6-175a-412b-bb6f-d951d32e5fab is a valid instance name {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] b34184c6-175a-412b-bb6f-d951d32e5fab has a disk file {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab is backed by 48cf2b6ea4724f5dea2150601674071272f2e3c1 {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] bad58580-6ead-4570-88e6-77275812fac2 is a valid instance name {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] bad58580-6ead-4570-88e6-77275812fac2 has a disk file {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 is backed by 48cf2b6ea4724f5dea2150601674071272f2e3c1 {{(pid=75244) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 23:37:29 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753
Nov 29 23:37:29 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c
Nov 29 23:37:29 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8
Nov 29 23:37:29 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e
Nov 29 23:37:29 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e
Nov 29 23:37:29 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2
Nov 29 23:37:30 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691
Nov 29 23:37:30 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227
Nov 29 23:37:30 user nova-compute[75244]: WARNING nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Active base files: /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Removable base files: /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753 /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8 /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2 /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691 /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227 /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a6528f7dc60eb758b6bb08ac97b74c3e56b9a753
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/35f085e4a97753a02f0fe47aa63a96d1e077698c
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4308f91faed242d2a2d21c2d021daad6c75e7dd8
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e04ab15635840005835671e3926b8b28a444bd8e
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7ae6880d5cfe359ebbfcd5b2d9601f71b0c60f3e
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d319d3c308dc9a89279c5d7963913e3b9b52d3f2
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73d62816dfbaea01a73a1284fdd5d087e424c691
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a528e58c01512f303f30038594cce95d9891227
Nov 29 23:37:30 user nova-compute[75244]: INFO nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ddeb551ac769cccc4bd1a86c4c4deea85b09f8af
Nov 29 23:37:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Verification complete {{(pid=75244) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 23:37:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Verify swap images {{(pid=75244) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 23:37:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.imagecache [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Verify ephemeral images {{(pid=75244) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 23:37:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:37:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:37:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:55 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing instance network info cache due to event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG nova.network.neutron [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:37:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:37:56 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:37:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=24.96599578857422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'flavor' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:37:57 user nova-compute[75244]: INFO nova.compute.manager [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Attaching volume e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 to /dev/vdb
Nov 29 23:37:57 user nova-compute[75244]: DEBUG os_brick.utils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb76270-ed04-48dd-9817-dec172be2373]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab576b-dbaa-4e16-9f48-835b8157ff8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updated VIF entry in instance network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.network.neutron [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d90fe-bfa6-4a6c-a28c-4951e32e217d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[931381c6-2c1a-44d9-a0c9-bc13b7f07bae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7ede551f-3f26-4710-b5ca-0bd41d819fb4 req-a58a975d-0b9f-4bee-88e0-5a5fa5e4f65a service nova] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:37:57 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:37:57 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2353723-f349-4280-bc39-1c8ec00e9cca]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG os_brick.utils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:37:57 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating existing volume attachment record: a31420a0-0542-47a5-a0d3-6c65fc031ed8 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:37:59 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:37:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:38:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:38:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmoKtnXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:38:05 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:38:05 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:38:05 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b99390a-4302-4b20-9498-4c6735317542]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:38:05 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dccd67a-b255-4245-9319-65d787002084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6] added
Nov 29 23:38:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceacfa2-cdd4-48eb-b8bd-4a4353597af3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee46e41-d860-495c-bc9b-b37ea540ae66]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmoKtnXM {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmoKtnXM" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db86e1-e2a9-48c2-9226-25ab1c171a02]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmoKtnXM'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e5e00-6027-48ab-b48b-61d6a18b7ab0]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dbbf76-eeab-4bb9-87c4-ef3616688445]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:38:05 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:38:05 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:38:05 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:38:05 user nova-compute[75244]: 
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe746e-33e1-4521-b95c-301ba9ffe783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260]
Nov 29 23:38:05 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260] successful.
Nov 29 23:38:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4695f484-3435-47e6-b3f9-be4f969cb6bc]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ddeebe-4350-4c52-bbb9-12d32ea3faf8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 (non-flash)
Nov 29 23:38:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 (non-flash)
Nov 29 23:38:05 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c70652-4322-4d71-a072-da15183c67e7]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:38:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmoKtnXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23033346461633432', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033346461633432', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'flavor' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 23:38:06 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:38:06 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:38:06 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:38:06 user nova-compute[75244]:   <serial>e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6</serial>
Nov 29 23:38:06 user nova-compute[75244]: </disk>
Nov 29 23:38:06 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:38:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:28:ef:22, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:38:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8b0bc902-e6cb-49d6-a9d3-3a65a10fdeae tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.712s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:08 user nova-compute[75244]: INFO nova.compute.manager [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Rescuing
Nov 29 23:38:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-a0b8db26-1e4f-4ab8-a8cc-68fc7ae308f5 req-7e29f49f-f0cb-4ef7-928c-f05f522acf5e service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a0b8db26-1e4f-4ab8-a8cc-68fc7ae308f5 req-7e29f49f-f0cb-4ef7-928c-f05f522acf5e service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a0b8db26-1e4f-4ab8-a8cc-68fc7ae308f5 req-7e29f49f-f0cb-4ef7-928c-f05f522acf5e service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a0b8db26-1e4f-4ab8-a8cc-68fc7ae308f5 req-7e29f49f-f0cb-4ef7-928c-f05f522acf5e service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-a0b8db26-1e4f-4ab8-a8cc-68fc7ae308f5 req-7e29f49f-f0cb-4ef7-928c-f05f522acf5e service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:38:08 user nova-compute[75244]: WARNING nova.compute.manager [req-a0b8db26-1e4f-4ab8-a8cc-68fc7ae308f5 req-7e29f49f-f0cb-4ef7-928c-f05f522acf5e service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state active and task_state rescuing.
Nov 29 23:38:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance destroyed successfully.
Nov 29 23:38:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Attempting rescue
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75244) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance directory exists: not creating {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 23:38:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Creating image(s)
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'trusted_certs' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue" returned: 0 in 0.047s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'migration_context' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.base [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<725b4714-75a3-4278-a5f7-d132e3d44769> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Start _get_guest_xml network_info=[{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:28:ef:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb216299-2134-4398-939c-137bca845056', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'resources' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.base [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<725b4714-75a3-4278-a5f7-d132e3d44769> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'numa_topology' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.base [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<725b4714-75a3-4278-a5f7-d132e3d44769> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:38:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:38:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'vcpu_model' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.base [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<725b4714-75a3-4278-a5f7-d132e3d44769> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187135369',display_name='tempest-ServerRescueNegativeTestJSON-server-187135369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187135369',id=46,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLANfbqNTBPktn6TB4m7fDoKQj2v9k5wxf1b+7Xq9Yjj7ux2FEJTIVAU8bzGg/Ws8d+bekmNCs/arZydrciVjekgGo9V3ISfigZf8MX77dvbCjgN/exaigKGbweRtjCEOA==',key_name='tempest-keypair-1064301684',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-jfc3zhe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=725b4714-75a3-4278-a5f7-d132e3d44769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:28:ef:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "vif_mac": "fa:16:3e:28:ef:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'pci_devices' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.objects.base [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Object Instance<725b4714-75a3-4278-a5f7-d132e3d44769> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75244) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:38:09 user nova-compute[75244]:   <uuid>725b4714-75a3-4278-a5f7-d132e3d44769</uuid>
Nov 29 23:38:09 user nova-compute[75244]:   <name>instance-0000002e</name>
Nov 29 23:38:09 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:38:09 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:38:09 user nova-compute[75244]:   <metadata>
Nov 29 23:38:09 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:38:09 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:38:09 user nova-compute[75244]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-187135369</nova:name>
Nov 29 23:38:09 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:38:09</nova:creationTime>
Nov 29 23:38:09 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:38:09 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:38:09 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:38:09 user nova-compute[75244]:       <nova:owner>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:user uuid="a4d9a446d0de4c2bb89a407a06c525c0">tempest-ServerRescueNegativeTestJSON-118232042-project-member</nova:user>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:project uuid="4228ad537cb649008a40179bb34ad326">tempest-ServerRescueNegativeTestJSON-118232042</nova:project>
Nov 29 23:38:09 user nova-compute[75244]:       </nova:owner>
Nov 29 23:38:09 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 29 23:38:09 user nova-compute[75244]:       <nova:ports>
Nov 29 23:38:09 user nova-compute[75244]:         <nova:port uuid="1ac39750-7229-4983-b7e3-a6ca2c301cc7">
Nov 29 23:38:09 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 23:38:09 user nova-compute[75244]:         </nova:port>
Nov 29 23:38:09 user nova-compute[75244]:       </nova:ports>
Nov 29 23:38:09 user nova-compute[75244]:     </nova:instance>
Nov 29 23:38:09 user nova-compute[75244]:   </metadata>
Nov 29 23:38:09 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:38:09 user nova-compute[75244]:     <system>
Nov 29 23:38:09 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:38:09 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:38:09 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:38:09 user nova-compute[75244]:       <entry name="serial">725b4714-75a3-4278-a5f7-d132e3d44769</entry>
Nov 29 23:38:09 user nova-compute[75244]:       <entry name="uuid">725b4714-75a3-4278-a5f7-d132e3d44769</entry>
Nov 29 23:38:09 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:38:09 user nova-compute[75244]:     </system>
Nov 29 23:38:09 user nova-compute[75244]:   </sysinfo>
Nov 29 23:38:09 user nova-compute[75244]:   <os>
Nov 29 23:38:09 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:38:09 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:38:09 user nova-compute[75244]:   </os>
Nov 29 23:38:09 user nova-compute[75244]:   <features>
Nov 29 23:38:09 user nova-compute[75244]:     <acpi/>
Nov 29 23:38:09 user nova-compute[75244]:     <apic/>
Nov 29 23:38:09 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:38:09 user nova-compute[75244]:   </features>
Nov 29 23:38:09 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:38:09 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:38:09 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:38:09 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:38:09 user nova-compute[75244]:   </clock>
Nov 29 23:38:09 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:38:09 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:38:09 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:38:09 user nova-compute[75244]:   </cpu>
Nov 29 23:38:09 user nova-compute[75244]:   <devices>
Nov 29 23:38:09 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:38:09 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:38:09 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue"/>
Nov 29 23:38:09 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:38:09 user nova-compute[75244]:     </disk>
Nov 29 23:38:09 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 29 23:38:09 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 23:38:09 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk"/>
Nov 29 23:38:09 user nova-compute[75244]:       <target dev="vdb" bus="virtio"/>
Nov 29 23:38:09 user nova-compute[75244]:     </disk>
Nov 29 23:38:09 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:38:09 user nova-compute[75244]:       <mac address="fa:16:3e:28:ef:22"/>
Nov 29 23:38:09 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:38:09 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:38:09 user nova-compute[75244]:       <target dev="tap1ac39750-72"/>
Nov 29 23:38:09 user nova-compute[75244]:     </interface>
Nov 29 23:38:09 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:38:09 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/console.log" append="off"/>
Nov 29 23:38:09 user nova-compute[75244]:     </serial>
Nov 29 23:38:09 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:38:09 user nova-compute[75244]:     <video>
Nov 29 23:38:09 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:38:09 user nova-compute[75244]:     </video>
Nov 29 23:38:09 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:38:09 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:38:09 user nova-compute[75244]:     </rng>
Nov 29 23:38:09 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:38:09 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:38:09 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:38:09 user nova-compute[75244]:     </memballoon>
Nov 29 23:38:09 user nova-compute[75244]:   </devices>
Nov 29 23:38:09 user nova-compute[75244]: </domain>
Nov 29 23:38:09 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:38:09 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance destroyed successfully.
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:38:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] No VIF found with MAC fa:16:3e:28:ef:22, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:38:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-7b057d09-d08c-4f9e-934b-b5cb384bcce9 req-4e777d74-1c3f-4c28-b813-335cfb1063a9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:38:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7b057d09-d08c-4f9e-934b-b5cb384bcce9 req-4e777d74-1c3f-4c28-b813-335cfb1063a9 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7b057d09-d08c-4f9e-934b-b5cb384bcce9 req-4e777d74-1c3f-4c28-b813-335cfb1063a9 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-7b057d09-d08c-4f9e-934b-b5cb384bcce9 req-4e777d74-1c3f-4c28-b813-335cfb1063a9 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-7b057d09-d08c-4f9e-934b-b5cb384bcce9 req-4e777d74-1c3f-4c28-b813-335cfb1063a9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:38:10 user nova-compute[75244]: WARNING nova.compute.manager [req-7b057d09-d08c-4f9e-934b-b5cb384bcce9 req-4e777d74-1c3f-4c28-b813-335cfb1063a9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state active and task_state rescuing.
Nov 29 23:38:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:38:13 user nova-compute[75244]: WARNING nova.compute.manager [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state active and task_state rescuing.
Nov 29 23:38:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:38:13 user nova-compute[75244]: WARNING nova.compute.manager [req-29ab32ac-57cf-435d-8ba8-c629bf8c27e4 req-7ea1e2ca-8c28-4d22-a42d-561525d7c62d service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state active and task_state rescuing.
Nov 29 23:38:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2700fdb2-a86a-4171-ae3d-de49a431f4df tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:38:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:38:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:38:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:38:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "bad58580-6ead-4570-88e6-77275812fac2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "bad58580-6ead-4570-88e6-77275812fac2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:38:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:38:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:38:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:38:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=24.95477294921875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:38:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:39:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:39:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:39:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:39:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:39:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:39:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:39:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:39:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:39:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=24.954086303710938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:39:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:39:59 user nova-compute[75244]: INFO nova.compute.manager [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Unrescuing
Nov 29 23:39:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'flavor' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:39:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-3eecea32-085f-4591-8d63-449202221a59 req-8cc2ed30-3f86-4b76-873a-b022196f8955 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3eecea32-085f-4591-8d63-449202221a59 req-8cc2ed30-3f86-4b76-873a-b022196f8955 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3eecea32-085f-4591-8d63-449202221a59 req-8cc2ed30-3f86-4b76-873a-b022196f8955 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3eecea32-085f-4591-8d63-449202221a59 req-8cc2ed30-3f86-4b76-873a-b022196f8955 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-3eecea32-085f-4591-8d63-449202221a59 req-8cc2ed30-3f86-4b76-873a-b022196f8955 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:40:00 user nova-compute[75244]: WARNING nova.compute.manager [req-3eecea32-085f-4591-8d63-449202221a59 req-8cc2ed30-3f86-4b76-873a-b022196f8955 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:40:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance destroyed successfully.
Nov 29 23:40:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:40:02 user nova-compute[75244]: WARNING nova.compute.manager [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:40:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:40:02 user nova-compute[75244]: DEBUG nova.compute.manager [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:40:02 user nova-compute[75244]: WARNING nova.compute.manager [req-fd3b3f82-a785-4714-9a17-67952f40627f req-690ba6d7-e168-429e-b8e7-335a62db38b9 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 23:40:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6d08f017-12df-4a1f-89e0-41f0c5138af6 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:40:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-d31a93f2-40ac-4557-8a65-f1396c8f7555 req-3eface4c-cf76-4d6a-939d-fad7c25f1ff6 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:40:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d31a93f2-40ac-4557-8a65-f1396c8f7555 req-3eface4c-cf76-4d6a-939d-fad7c25f1ff6 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:40:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d31a93f2-40ac-4557-8a65-f1396c8f7555 req-3eface4c-cf76-4d6a-939d-fad7c25f1ff6 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:40:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d31a93f2-40ac-4557-8a65-f1396c8f7555 req-3eface4c-cf76-4d6a-939d-fad7c25f1ff6 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:40:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-d31a93f2-40ac-4557-8a65-f1396c8f7555 req-3eface4c-cf76-4d6a-939d-fad7c25f1ff6 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:40:04 user nova-compute[75244]: WARNING nova.compute.manager [req-d31a93f2-40ac-4557-8a65-f1396c8f7555 req-3eface4c-cf76-4d6a-939d-fad7c25f1ff6 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state active and task_state None.
Nov 29 23:40:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:40:05 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:40:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:40:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:40:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:40:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:57 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:40:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:40:58 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=24.952903747558594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:40:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:41:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:41:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:41:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:41:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:41:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:41:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:41:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:41:08 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [{"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:41:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-b34184c6-175a-412b-bb6f-d951d32e5fab" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:41:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:41:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:41:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:41:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:41:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:41:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:41:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:41:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:41:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:41:45 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing instance network info cache due to event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:41:51 user nova-compute[75244]: INFO nova.compute.manager [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Detaching volume e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updated VIF entry in instance network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:41:51 user nova-compute[75244]: INFO nova.virt.block_device [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Attempting to driver detach volume e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 from mountpoint /dev/vdb
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Attempting to detach device vdb from instance 725b4714-75a3-4278-a5f7-d132e3d44769 from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:41:51 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:41:51 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:41:51 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:41:51 user nova-compute[75244]:   <serial>e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6</serial>
Nov 29 23:41:51 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:41:51 user nova-compute[75244]: </disk>
Nov 29 23:41:51 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-dd08470a-31e7-4863-b197-b5d4533a80fd req-5b656dda-24c8-4a21-9003-f8f5e1b4bc74 service nova] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:41:51 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully detached device vdb from instance 725b4714-75a3-4278-a5f7-d132e3d44769 from the persistent domain config.
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 725b4714-75a3-4278-a5f7-d132e3d44769 from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 23:41:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 23:41:51 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:41:51 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 29 23:41:51 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 29 23:41:51 user nova-compute[75244]:   <serial>e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6</serial>
Nov 29 23:41:51 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 23:41:51 user nova-compute[75244]: </disk>
Nov 29 23:41:51 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 23:41:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG nova.compute.manager [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing instance network info cache due to event network-changed-1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Refreshing network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updated VIF entry in instance network info cache for port 1ac39750-7229-4983-b7e3-a6ca2c301cc7. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG nova.network.neutron [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:41:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9663eca3-883b-4886-b0d4-132a1cd2988e req-fbf5d4e7-e0bb-4bcd-b6a0-b905da1c1096 service nova] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:41:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:41:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:00 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:42:00 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=24.952190399169922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 725b4714-75a3-4278-a5f7-d132e3d44769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:42:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:42:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:42:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:42:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [{"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:42:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-725b4714-75a3-4278-a5f7-d132e3d44769" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:42:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:12 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 725b4714-75a3-4278-a5f7-d132e3d44769 is timed out.
Nov 29 23:42:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully detached device vdb from instance 725b4714-75a3-4278-a5f7-d132e3d44769 from the live domain config.
Nov 29 23:42:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmoKtnXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:42:12 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af04ae3-1948-4d17-a9dd-ace0cb0b9818]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:42:12 user nova-compute[75244]: No targets found.
Nov 29 23:42:12 user nova-compute[75244]: iSNS:
Nov 29 23:42:12 user nova-compute[75244]: No targets found.
Nov 29 23:42:12 user nova-compute[75244]: STATIC:
Nov 29 23:42:12 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6
Nov 29 23:42:12 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:42:12 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:42:12 user nova-compute[75244]: FIRMWARE:
Nov 29 23:42:12 user nova-compute[75244]: No targets found.
Nov 29 23:42:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:42:12 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:42:12 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c30e67-b791-4796-b690-4a0e970221fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ab89d2-2415-4474-b231-fc6d6849883b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 (non-flash)
Nov 29 23:42:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 (non-flash)
Nov 29 23:42:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804460af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a0e246-204e-4fbb-b79f-e86c2a93dfa2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[018ab310-add5-4690-a1ef-31610c18d5e7]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8b7ce7-2adc-434b-bf26-8d7e255d23fe]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[87badd27-5d8c-4f6c-aba5-2449bd9b9377]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb8d47a-c64b-4dc0-b466-8c4cabc3a36a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.038s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8da1d-b301-4733-80a5-44e880abb05d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260]
Nov 29 23:42:12 user nova-compute[75244]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6, portal: 172.16.0.220,3260] successful.
Nov 29 23:42:12 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7af7fc3-5be4-4ba6-8a25-0a174cbda0f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e991e-9087-427c-af5b-61fb278f5b22]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] <== disconnect_volume: return (272ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:42:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:42:13 user nova-compute[75244]: DEBUG nova.objects.instance [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'flavor' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:42:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-15e99fed-8212-48e2-8b6e-ce3bd421b78b tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:42:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:42:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:20 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:42:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:30 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:41 user nova-compute[75244]: INFO nova.compute.manager [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Terminating instance
Nov 29 23:42:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-01c0a675-dba2-466e-8b89-f60e608a1f30 req-ed488a33-4528-40fb-a16f-bf8406b06ae0 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-01c0a675-dba2-466e-8b89-f60e608a1f30 req-ed488a33-4528-40fb-a16f-bf8406b06ae0 service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-01c0a675-dba2-466e-8b89-f60e608a1f30 req-ed488a33-4528-40fb-a16f-bf8406b06ae0 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-01c0a675-dba2-466e-8b89-f60e608a1f30 req-ed488a33-4528-40fb-a16f-bf8406b06ae0 service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-01c0a675-dba2-466e-8b89-f60e608a1f30 req-ed488a33-4528-40fb-a16f-bf8406b06ae0 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-01c0a675-dba2-466e-8b89-f60e608a1f30 req-ed488a33-4528-40fb-a16f-bf8406b06ae0 service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-unplugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Instance destroyed successfully.
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'resources' on Instance uuid 725b4714-75a3-4278-a5f7-d132e3d44769 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187135369',display_name='tempest-ServerRescueNegativeTestJSON-server-187135369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187135369',id=46,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLANfbqNTBPktn6TB4m7fDoKQj2v9k5wxf1b+7Xq9Yjj7ux2FEJTIVAU8bzGg/Ws8d+bekmNCs/arZydrciVjekgGo9V3ISfigZf8MX77dvbCjgN/exaigKGbweRtjCEOA==',key_name='tempest-keypair-1064301684',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-jfc3zhe3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:40:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=725b4714-75a3-4278-a5f7-d132e3d44769,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "address": "fa:16:3e:28:ef:22", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ac39750-72", "ovs_interfaceid": "1ac39750-7229-4983-b7e3-a6ca2c301cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG os_vif [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ac39750-72, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=417297d9-77cb-4789-b9c7-e89b806367db) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:42 user nova-compute[75244]: INFO os_vif [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:ef:22,bridge_name='br-int',has_traffic_filtering=True,id=1ac39750-7229-4983-b7e3-a6ca2c301cc7,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ac39750-72')
Nov 29 23:42:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Deleting instance files /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769_del
Nov 29 23:42:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Deletion of /opt/stack/data/nova/instances/725b4714-75a3-4278-a5f7-d132e3d44769_del complete
Nov 29 23:42:42 user nova-compute[75244]: INFO nova.compute.manager [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 23:42:42 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:42:42 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:42:43 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:42:43 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Took 0.70 seconds to deallocate network for instance.
Nov 29 23:42:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-d6aeb64a-3a02-46d8-b0d8-bd356f77d05f req-c358ee71-66bb-4b3d-9a1f-c87ff408a8ae service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-deleted-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:42:43 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:42:43 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:42:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:43 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Deleted allocations for instance 725b4714-75a3-4278-a5f7-d132e3d44769
Nov 29 23:42:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8fc0b16d-8915-4b63-be8d-2ed12c604750 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "725b4714-75a3-4278-a5f7-d132e3d44769" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-d57b54f9-b44c-4c6c-a6f3-e0655503bfd9 req-dc5d103c-2c6b-4874-aaa8-653aa01f2b6f service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:42:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d57b54f9-b44c-4c6c-a6f3-e0655503bfd9 req-dc5d103c-2c6b-4874-aaa8-653aa01f2b6f service nova] Acquiring lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d57b54f9-b44c-4c6c-a6f3-e0655503bfd9 req-dc5d103c-2c6b-4874-aaa8-653aa01f2b6f service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-d57b54f9-b44c-4c6c-a6f3-e0655503bfd9 req-dc5d103c-2c6b-4874-aaa8-653aa01f2b6f service nova] Lock "725b4714-75a3-4278-a5f7-d132e3d44769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-d57b54f9-b44c-4c6c-a6f3-e0655503bfd9 req-dc5d103c-2c6b-4874-aaa8-653aa01f2b6f service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] No waiting events found dispatching network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:42:44 user nova-compute[75244]: WARNING nova.compute.manager [req-d57b54f9-b44c-4c6c-a6f3-e0655503bfd9 req-dc5d103c-2c6b-4874-aaa8-653aa01f2b6f service nova] [instance: 725b4714-75a3-4278-a5f7-d132e3d44769] Received unexpected event network-vif-plugged-1ac39750-7229-4983-b7e3-a6ca2c301cc7 for instance with vm_state deleted and task_state None.
Nov 29 23:42:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:42:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:42:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:42:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:58 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:42:59 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:42:59 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:42:59 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=24.979522705078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:42:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance b34184c6-175a-412b-bb6f-d951d32e5fab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:43:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:43:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [{"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-bad58580-6ead-4570-88e6-77275812fac2" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:43:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:43:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:43:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:43:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:43:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:43:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:43:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:43:42 user nova-compute[75244]: INFO nova.compute.manager [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Terminating instance
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-322d568a-962b-4669-90f6-479758eaa9c8 req-a9be758d-979b-4557-84a3-74c4b6775ddf service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-unplugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-322d568a-962b-4669-90f6-479758eaa9c8 req-a9be758d-979b-4557-84a3-74c4b6775ddf service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-322d568a-962b-4669-90f6-479758eaa9c8 req-a9be758d-979b-4557-84a3-74c4b6775ddf service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-322d568a-962b-4669-90f6-479758eaa9c8 req-a9be758d-979b-4557-84a3-74c4b6775ddf service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-322d568a-962b-4669-90f6-479758eaa9c8 req-a9be758d-979b-4557-84a3-74c4b6775ddf service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-unplugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.compute.manager [req-322d568a-962b-4669-90f6-479758eaa9c8 req-a9be758d-979b-4557-84a3-74c4b6775ddf service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-unplugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Instance destroyed successfully.
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.objects.instance [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'resources' on Instance uuid b34184c6-175a-412b-bb6f-d951d32e5fab {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1237813919',display_name='tempest-ServerRescueNegativeTestJSON-server-1237813919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1237813919',id=44,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:29:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-2zd13hq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:29:31Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=b34184c6-175a-412b-bb6f-d951d32e5fab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "address": "fa:16:3e:db:28:84", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68f2f494-ae", "ovs_interfaceid": "68f2f494-ae50-418e-a6d6-a369c77cac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG os_vif [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68f2f494-ae, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6cf6e9d-479e-487e-8a8e-26f3f9330ddd) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:43:42 user nova-compute[75244]: INFO os_vif [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:28:84,bridge_name='br-int',has_traffic_filtering=True,id=68f2f494-ae50-418e-a6d6-a369c77cac5a,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68f2f494-ae')
Nov 29 23:43:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Deleting instance files /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab_del
Nov 29 23:43:42 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Deletion of /opt/stack/data/nova/instances/b34184c6-175a-412b-bb6f-d951d32e5fab_del complete
Nov 29 23:43:42 user nova-compute[75244]: INFO nova.compute.manager [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 23:43:42 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:43:42 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:43:43 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Took 0.49 seconds to deallocate network for instance.
Nov 29 23:43:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-08c6d6f0-c0a5-4372-992f-73073fe20078 req-3289741e-1796-4151-ba6a-16d12e1ff830 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-deleted-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:43:43 user nova-compute[75244]: INFO nova.compute.manager [req-08c6d6f0-c0a5-4372-992f-73073fe20078 req-3289741e-1796-4151-ba6a-16d12e1ff830 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Neutron deleted interface 68f2f494-ae50-418e-a6d6-a369c77cac5a; detaching it from the instance and deleting it from the info cache
Nov 29 23:43:43 user nova-compute[75244]: DEBUG nova.network.neutron [req-08c6d6f0-c0a5-4372-992f-73073fe20078 req-3289741e-1796-4151-ba6a-16d12e1ff830 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG nova.compute.manager [req-08c6d6f0-c0a5-4372-992f-73073fe20078 req-3289741e-1796-4151-ba6a-16d12e1ff830 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Detach interface failed, port_id=68f2f494-ae50-418e-a6d6-a369c77cac5a, reason: Instance b34184c6-175a-412b-bb6f-d951d32e5fab could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:43:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:43:43 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Deleted allocations for instance b34184c6-175a-412b-bb6f-d951d32e5fab
Nov 29 23:43:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-10172f52-351f-4649-a5b0-9793a195bd7d tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.473s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:43:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-854d7013-5b5f-4438-9b5c-f53b236efa9d req-853fdc35-2842-43d1-912a-e725f8e09918 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:43:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-854d7013-5b5f-4438-9b5c-f53b236efa9d req-853fdc35-2842-43d1-912a-e725f8e09918 service nova] Acquiring lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:43:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-854d7013-5b5f-4438-9b5c-f53b236efa9d req-853fdc35-2842-43d1-912a-e725f8e09918 service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:43:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-854d7013-5b5f-4438-9b5c-f53b236efa9d req-853fdc35-2842-43d1-912a-e725f8e09918 service nova] Lock "b34184c6-175a-412b-bb6f-d951d32e5fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:43:44 user nova-compute[75244]: DEBUG nova.compute.manager [req-854d7013-5b5f-4438-9b5c-f53b236efa9d req-853fdc35-2842-43d1-912a-e725f8e09918 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] No waiting events found dispatching network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:43:44 user nova-compute[75244]: WARNING nova.compute.manager [req-854d7013-5b5f-4438-9b5c-f53b236efa9d req-853fdc35-2842-43d1-912a-e725f8e09918 service nova] [instance: b34184c6-175a-412b-bb6f-d951d32e5fab] Received unexpected event network-vif-plugged-68f2f494-ae50-418e-a6d6-a369c77cac5a for instance with vm_state deleted and task_state None.
Nov 29 23:43:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:43:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:44:00 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:44:01 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:44:01 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.0069580078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance bad58580-6ead-4570-88e6-77275812fac2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:44:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:44:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:44:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:44:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:44:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:44:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:44:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:44:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:44:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:44:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:44:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "bad58580-6ead-4570-88e6-77275812fac2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:32 user nova-compute[75244]: INFO nova.compute.manager [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Terminating instance
Nov 29 23:44:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-975ec1cd-9aee-4c19-8020-c56a0e6ef704 req-428e42de-34c4-4d0e-b2e3-efd0d0b5fdfb service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-975ec1cd-9aee-4c19-8020-c56a0e6ef704 req-428e42de-34c4-4d0e-b2e3-efd0d0b5fdfb service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-975ec1cd-9aee-4c19-8020-c56a0e6ef704 req-428e42de-34c4-4d0e-b2e3-efd0d0b5fdfb service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-975ec1cd-9aee-4c19-8020-c56a0e6ef704 req-428e42de-34c4-4d0e-b2e3-efd0d0b5fdfb service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-975ec1cd-9aee-4c19-8020-c56a0e6ef704 req-428e42de-34c4-4d0e-b2e3-efd0d0b5fdfb service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:44:32 user nova-compute[75244]: DEBUG nova.compute.manager [req-975ec1cd-9aee-4c19-8020-c56a0e6ef704 req-428e42de-34c4-4d0e-b2e3-efd0d0b5fdfb service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-unplugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:33 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Instance destroyed successfully.
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lazy-loading 'resources' on Instance uuid bad58580-6ead-4570-88e6-77275812fac2 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1752411322',display_name='tempest-ServerRescueNegativeTestJSON-server-1752411322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1752411322',id=43,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:32:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228ad537cb649008a40179bb34ad326',ramdisk_id='',reservation_id='r-z69wlmvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-118232042',owner_user_name='tempest-ServerRescueNegativeTestJSON-118232042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:34:15Z,user_data=None,user_id='a4d9a446d0de4c2bb89a407a06c525c0',uuid=bad58580-6ead-4570-88e6-77275812fac2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converting VIF {"id": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "address": "fa:16:3e:78:fb:29", "network": {"id": "55bef64e-a17e-4d70-8b00-fb3de66a0875", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-811404391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228ad537cb649008a40179bb34ad326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d732042-5c", "ovs_interfaceid": "0d732042-5c82-4211-96b1-e9e6ef4d5533", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG os_vif [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d732042-5c, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d85f5f86-7cb4-4803-ab26-3ca2627ac9b8) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:33 user nova-compute[75244]: INFO os_vif [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:fb:29,bridge_name='br-int',has_traffic_filtering=True,id=0d732042-5c82-4211-96b1-e9e6ef4d5533,network=Network(55bef64e-a17e-4d70-8b00-fb3de66a0875),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d732042-5c')
Nov 29 23:44:33 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Deleting instance files /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2_del
Nov 29 23:44:33 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Deletion of /opt/stack/data/nova/instances/bad58580-6ead-4570-88e6-77275812fac2_del complete
Nov 29 23:44:33 user nova-compute[75244]: INFO nova.compute.manager [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] [instance: bad58580-6ead-4570-88e6-77275812fac2] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 23:44:33 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:44:33 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: bad58580-6ead-4570-88e6-77275812fac2] Took 0.44 seconds to deallocate network for instance.
Nov 29 23:44:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:34 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Deleted allocations for instance bad58580-6ead-4570-88e6-77275812fac2
Nov 29 23:44:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e8793cfb-6aa3-47e2-b924-73c831ec6d44 tempest-ServerRescueNegativeTestJSON-118232042 tempest-ServerRescueNegativeTestJSON-118232042-project-member] Lock "bad58580-6ead-4570-88e6-77275812fac2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.570s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] Acquiring lock "bad58580-6ead-4570-88e6-77275812fac2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] Lock "bad58580-6ead-4570-88e6-77275812fac2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:44:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] No waiting events found dispatching network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:44:34 user nova-compute[75244]: WARNING nova.compute.manager [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received unexpected event network-vif-plugged-0d732042-5c82-4211-96b1-e9e6ef4d5533 for instance with vm_state deleted and task_state None.
Nov 29 23:44:34 user nova-compute[75244]: DEBUG nova.compute.manager [req-c6bdfaf9-ea4c-4753-852a-8e1d715a22fb req-83636c33-7dec-4d57-84a1-7c5643d4419c service nova] [instance: bad58580-6ead-4570-88e6-77275812fac2] Received event network-vif-deleted-0d732042-5c82-4211-96b1-e9e6ef4d5533 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:44:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:44:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:44:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:44:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:44:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:44:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:45:02 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:45:02 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9148MB free_disk=25.034515380859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:45:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:45:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:03 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:45:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:45:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:45:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:45:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:45:23 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:45:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:25 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:45:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:45:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:45:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:45:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:45:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:45:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:45:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:45:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:00 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:02 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:46:02 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=25.02423858642578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:46:02 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:46:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:46:10 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:46:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:46:14 user nova-compute[75244]: INFO nova.compute.claims [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Claim successful on node user
Nov 29 23:46:14 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:46:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:46:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:46:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:46:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:46:15 user nova-compute[75244]: DEBUG nova.policy [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5ff1ce050ce4d3eb6beacb200c31c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6184f3bb14443693af3012edc107b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:46:15 user nova-compute[75244]: INFO nova.virt.block_device [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Booting with volume snapshot a8f51f73-1126-47f6-a8e8-1320c9e53a72 at /dev/vda
Nov 29 23:46:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Successfully created port: b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Successfully updated port: b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquired lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-changed-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Refreshing instance network info cache due to event network-changed-b3be6c3f-a066-416e-9e1b-82901aef5684. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] Acquiring lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updating instance_info_cache with network_info: [{"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Releasing lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Instance network_info: |[{"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] Acquired lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Refreshing network info cache for port b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updated VIF entry in instance network info cache for port b3be6c3f-a066-416e-9e1b-82901aef5684. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updating instance_info_cache with network_info: [{"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:46:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0d6572d5-bcca-4549-a97f-582da3ca5fed req-4099327d-451e-4a92-92e3-a298aad99fc4 service nova] Releasing lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:46:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG os_brick.utils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b38cbd-f113-4d3b-b456-c508de1c35da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9d814-6c32-42a4-b244-a539a9ba2acf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb1ef9-3eb0-45f1-bd14-5aa66d2e0881]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40c2f3-b35b-46d6-97e7-4fa7d04741d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:46:20 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:46:20 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe1594b-eedb-4a2c-abd8-d85fd64be470]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG os_brick.utils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:46:20 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updating existing volume attachment record: a9c1b0bf-898d-4c41-ac88-f4b788063dfd {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:46:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:46:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:25 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:25 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:46:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:46:28 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Creating image(s)
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Ensure instance console log exists: /opt/stack/data/nova/instances/2337bf9a-d4fb-491b-81c3-5de716ec30c1/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Start _get_guest_xml network_info=[{"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkRhrcIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2337bf9a-d4fb-491b-81c3-5de716ec30c1', 'attached_at': '', 'detached_at': '', 'volume_id': '057eed0c-e7a3-44ff-849c-cf70e6796384', 'serial': '057eed0c-e7a3-44ff-849c-cf70e6796384'}, 'attachment_id': 'a9c1b0bf-898d-4c41-ac88-f4b788063dfd', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:46:28 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:46:28 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkRhrcIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:46:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:46:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:46:28 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:46:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a132d40-b0a9-4ff1-ab30-eb4702dcfc37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:46:28 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b73b33-5910-41a0-8884-6e85c1d00d74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384] added
Nov 29 23:46:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc5eab3-a70a-457f-849d-be770599210d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf500a2-711b-41fe-a624-61d76b0cd2f4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkRhrcIC {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkRhrcIC" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaabc6b0-d560-44de-98f6-559a3beb3cf9]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkRhrcIC'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4174fd27-742d-4b1c-ae0a-436e7d394c47]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b97fff-aa65-4129-b15b-44466fa7639f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:46:28 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:46:28 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:46:28 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:46:28 user nova-compute[75244]: 
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c19b4-f671-4fc5-93c4-8b87bc5a6e6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260]
Nov 29 23:46:28 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260] successful.
Nov 29 23:46:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4285f7-4498-4ee3-99b0-cc86252e367f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[33724b62-16b1-4c0f-b669-71f86de860eb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 (non-flash)
Nov 29 23:46:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 (non-flash)
Nov 29 23:46:28 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c41cc2-3334-46c0-bd3e-fa6462e04b53]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:46:28 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkRhrcIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23037363337346238', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037363337346238', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-80188572',display_name='tempest-TestVolumeBootPattern-server-80188572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-80188572',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-01cxkigl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:46:15Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=2337bf9a-d4fb-491b-81c3-5de716ec30c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.objects.instance [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'pci_devices' on Instance uuid 2337bf9a-d4fb-491b-81c3-5de716ec30c1 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:46:29 user nova-compute[75244]:   <uuid>2337bf9a-d4fb-491b-81c3-5de716ec30c1</uuid>
Nov 29 23:46:29 user nova-compute[75244]:   <name>instance-0000002f</name>
Nov 29 23:46:29 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:46:29 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:46:29 user nova-compute[75244]:   <metadata>
Nov 29 23:46:29 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:46:29 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:46:29 user nova-compute[75244]:       <nova:name>tempest-TestVolumeBootPattern-server-80188572</nova:name>
Nov 29 23:46:29 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:46:28</nova:creationTime>
Nov 29 23:46:29 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:46:29 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:46:29 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:46:29 user nova-compute[75244]:       <nova:owner>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:user uuid="d5ff1ce050ce4d3eb6beacb200c31c16">tempest-TestVolumeBootPattern-1146673908-project-member</nova:user>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:project uuid="4c6184f3bb14443693af3012edc107b0">tempest-TestVolumeBootPattern-1146673908</nova:project>
Nov 29 23:46:29 user nova-compute[75244]:       </nova:owner>
Nov 29 23:46:29 user nova-compute[75244]:       <nova:ports>
Nov 29 23:46:29 user nova-compute[75244]:         <nova:port uuid="b3be6c3f-a066-416e-9e1b-82901aef5684">
Nov 29 23:46:29 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:46:29 user nova-compute[75244]:         </nova:port>
Nov 29 23:46:29 user nova-compute[75244]:       </nova:ports>
Nov 29 23:46:29 user nova-compute[75244]:     </nova:instance>
Nov 29 23:46:29 user nova-compute[75244]:   </metadata>
Nov 29 23:46:29 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:46:29 user nova-compute[75244]:     <system>
Nov 29 23:46:29 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:46:29 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:46:29 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:46:29 user nova-compute[75244]:       <entry name="serial">2337bf9a-d4fb-491b-81c3-5de716ec30c1</entry>
Nov 29 23:46:29 user nova-compute[75244]:       <entry name="uuid">2337bf9a-d4fb-491b-81c3-5de716ec30c1</entry>
Nov 29 23:46:29 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:46:29 user nova-compute[75244]:     </system>
Nov 29 23:46:29 user nova-compute[75244]:   </sysinfo>
Nov 29 23:46:29 user nova-compute[75244]:   <os>
Nov 29 23:46:29 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:46:29 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:46:29 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:46:29 user nova-compute[75244]:   </os>
Nov 29 23:46:29 user nova-compute[75244]:   <features>
Nov 29 23:46:29 user nova-compute[75244]:     <acpi/>
Nov 29 23:46:29 user nova-compute[75244]:     <apic/>
Nov 29 23:46:29 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:46:29 user nova-compute[75244]:   </features>
Nov 29 23:46:29 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:46:29 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:46:29 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:46:29 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:46:29 user nova-compute[75244]:   </clock>
Nov 29 23:46:29 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:46:29 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:46:29 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:46:29 user nova-compute[75244]:   </cpu>
Nov 29 23:46:29 user nova-compute[75244]:   <devices>
Nov 29 23:46:29 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:46:29 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:46:29 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:46:29 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:46:29 user nova-compute[75244]:       <serial>057eed0c-e7a3-44ff-849c-cf70e6796384</serial>
Nov 29 23:46:29 user nova-compute[75244]:     </disk>
Nov 29 23:46:29 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:46:29 user nova-compute[75244]:       <mac address="fa:16:3e:43:21:b6"/>
Nov 29 23:46:29 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:46:29 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:46:29 user nova-compute[75244]:       <target dev="tapb3be6c3f-a0"/>
Nov 29 23:46:29 user nova-compute[75244]:     </interface>
Nov 29 23:46:29 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:46:29 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/2337bf9a-d4fb-491b-81c3-5de716ec30c1/console.log" append="off"/>
Nov 29 23:46:29 user nova-compute[75244]:     </serial>
Nov 29 23:46:29 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:46:29 user nova-compute[75244]:     <video>
Nov 29 23:46:29 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:46:29 user nova-compute[75244]:     </video>
Nov 29 23:46:29 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:46:29 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:46:29 user nova-compute[75244]:     </rng>
Nov 29 23:46:29 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:46:29 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:46:29 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:46:29 user nova-compute[75244]:     </memballoon>
Nov 29 23:46:29 user nova-compute[75244]:   </devices>
Nov 29 23:46:29 user nova-compute[75244]: </domain>
Nov 29 23:46:29 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-80188572',display_name='tempest-TestVolumeBootPattern-server-80188572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-80188572',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-01cxkigl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:46:15Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=2337bf9a-d4fb-491b-81c3-5de716ec30c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG os_vif [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40296fba-1a5f-5e1d-888a-9bafcf946c2b', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3be6c3f-a0, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3be6c3f-a0, col_values=(('qos', UUID('b0082a58-624f-4a26-a416-8d0ab231c8c8')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3be6c3f-a0, col_values=(('external_ids', {'iface-id': 'b3be6c3f-a066-416e-9e1b-82901aef5684', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:21:b6', 'vm-uuid': '2337bf9a-d4fb-491b-81c3-5de716ec30c1'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:29 user nova-compute[75244]: INFO os_vif [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0')
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:46:29 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No VIF found with MAC fa:16:3e:43:21:b6, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-b76f2ff5-de30-4ffe-988f-2a7cfa2ea25c req-6323087f-26e3-4135-b795-be3781675ce7 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b76f2ff5-de30-4ffe-988f-2a7cfa2ea25c req-6323087f-26e3-4135-b795-be3781675ce7 service nova] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b76f2ff5-de30-4ffe-988f-2a7cfa2ea25c req-6323087f-26e3-4135-b795-be3781675ce7 service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b76f2ff5-de30-4ffe-988f-2a7cfa2ea25c req-6323087f-26e3-4135-b795-be3781675ce7 service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-b76f2ff5-de30-4ffe-988f-2a7cfa2ea25c req-6323087f-26e3-4135-b795-be3781675ce7 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] No waiting events found dispatching network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:46:31 user nova-compute[75244]: WARNING nova.compute.manager [req-b76f2ff5-de30-4ffe-988f-2a7cfa2ea25c req-6323087f-26e3-4135-b795-be3781675ce7 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received unexpected event network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 for instance with vm_state building and task_state spawning.
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:46:33 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Instance spawned successfully.
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:46:33 user nova-compute[75244]: INFO nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:46:33 user nova-compute[75244]: INFO nova.compute.manager [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Took 18.62 seconds to build instance.
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-1738d53c-aebb-4c57-a22d-867bf0c32533 req-b5dcb1c5-80e2-4c37-b93a-e27a4f1ef0a2 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1738d53c-aebb-4c57-a22d-867bf0c32533 req-b5dcb1c5-80e2-4c37-b93a-e27a4f1ef0a2 service nova] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1738d53c-aebb-4c57-a22d-867bf0c32533 req-b5dcb1c5-80e2-4c37-b93a-e27a4f1ef0a2 service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1738d53c-aebb-4c57-a22d-867bf0c32533 req-b5dcb1c5-80e2-4c37-b93a-e27a4f1ef0a2 service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:33 user nova-compute[75244]: DEBUG nova.compute.manager [req-1738d53c-aebb-4c57-a22d-867bf0c32533 req-b5dcb1c5-80e2-4c37-b93a-e27a4f1ef0a2 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] No waiting events found dispatching network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:46:33 user nova-compute[75244]: WARNING nova.compute.manager [req-1738d53c-aebb-4c57-a22d-867bf0c32533 req-b5dcb1c5-80e2-4c37-b93a-e27a4f1ef0a2 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received unexpected event network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 for instance with vm_state active and task_state None.
Nov 29 23:46:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-8534d56c-294f-46de-a53c-149f234e0862 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.713s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:46:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:46:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:46:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:46:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:46:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:46:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:46:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:46:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:46:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:46:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:47:04 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:47:04 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.022186279296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 2337bf9a-d4fb-491b-81c3-5de716ec30c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:47:04 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:47:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:47:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:47:06 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 2337bf9a-d4fb-491b-81c3-5de716ec30c1 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updating instance_info_cache with network_info: [{"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-2337bf9a-d4fb-491b-81c3-5de716ec30c1" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:47:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:47:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:47:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:47:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:47:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:47:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:47:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:48:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:48:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:48:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:48:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:48:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=25.021591186523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:05 user nova-compute[75244]: INFO nova.compute.manager [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Terminating instance
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.manager [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 2337bf9a-d4fb-491b-81c3-5de716ec30c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:05 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-26113ee5-922d-4e15-aff0-3dcd7bd6c261 req-fde649e6-be16-4127-8daf-6ab5991cd3da service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-vif-unplugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-26113ee5-922d-4e15-aff0-3dcd7bd6c261 req-fde649e6-be16-4127-8daf-6ab5991cd3da service nova] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-26113ee5-922d-4e15-aff0-3dcd7bd6c261 req-fde649e6-be16-4127-8daf-6ab5991cd3da service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-26113ee5-922d-4e15-aff0-3dcd7bd6c261 req-fde649e6-be16-4127-8daf-6ab5991cd3da service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-26113ee5-922d-4e15-aff0-3dcd7bd6c261 req-fde649e6-be16-4127-8daf-6ab5991cd3da service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] No waiting events found dispatching network-vif-unplugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.compute.manager [req-26113ee5-922d-4e15-aff0-3dcd7bd6c261 req-fde649e6-be16-4127-8daf-6ab5991cd3da service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-vif-unplugged-b3be6c3f-a066-416e-9e1b-82901aef5684 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Instance destroyed successfully.
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.objects.instance [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'resources' on Instance uuid 2337bf9a-d4fb-491b-81c3-5de716ec30c1 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-80188572',display_name='tempest-TestVolumeBootPattern-server-80188572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-80188572',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:46:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-01cxkigl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:46:33Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=2337bf9a-d4fb-491b-81c3-5de716ec30c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "b3be6c3f-a066-416e-9e1b-82901aef5684", "address": "fa:16:3e:43:21:b6", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3be6c3f-a0", "ovs_interfaceid": "b3be6c3f-a066-416e-9e1b-82901aef5684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_vif [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3be6c3f-a0, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0082a58-624f-4a26-a416-8d0ab231c8c8) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:06 user nova-compute[75244]: INFO os_vif [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=b3be6c3f-a066-416e-9e1b-82901aef5684,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3be6c3f-a0')
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkRhrcIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:48:06 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebfd56-0fab-4e83-b4cf-95ca645b1627]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:48:06 user nova-compute[75244]: No targets found.
Nov 29 23:48:06 user nova-compute[75244]: iSNS:
Nov 29 23:48:06 user nova-compute[75244]: No targets found.
Nov 29 23:48:06 user nova-compute[75244]: STATIC:
Nov 29 23:48:06 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384
Nov 29 23:48:06 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:48:06 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:48:06 user nova-compute[75244]: FIRMWARE:
Nov 29 23:48:06 user nova-compute[75244]: No targets found.
Nov 29 23:48:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:48:06 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:48:06 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb64fa-32ee-4807-ab02-721c89f759a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa61c46f-cea2-4fd7-9d05-af34b3971f08]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 (non-flash)
Nov 29 23:48:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 (non-flash)
Nov 29 23:48:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c1aa440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef9c8bb-cba6-4fd2-b76d-d87e66325728]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[472261d1-f808-45dd-8c03-f40696abd11e]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6054a10e-efbc-4ce5-bb61-95750fd6731d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436014f-3fa0-4d8b-8b9e-91ae90f87d90]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_22b1627d', '/dev/disk/by-id/scsi-23037363337346238', '/dev/disk/by-id/scsi-1SCST_BIO22b1627d-076374b895d4b649') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c87acac-8bb3-4e69-b126-13ba38d7b1a7]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a25aa1-a452-474f-9aee-1dfc938c9d28]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a9865-1e8b-46a8-9054-c6ba058b1e9b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260]
Nov 29 23:48:06 user nova-compute[75244]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384, portal: 172.16.0.220,3260] successful.
Nov 29 23:48:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057eed0c-e7a3-44ff-849c-cf70e6796384 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[07345dd9-ce4c-4d80-8af5-24d85864ea82]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== disconnect_volume: return (304ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:48:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Deleting instance files /opt/stack/data/nova/instances/2337bf9a-d4fb-491b-81c3-5de716ec30c1_del
Nov 29 23:48:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Deletion of /opt/stack/data/nova/instances/2337bf9a-d4fb-491b-81c3-5de716ec30c1_del complete
Nov 29 23:48:06 user nova-compute[75244]: INFO nova.compute.manager [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 23:48:06 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:48:06 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:48:07 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:48:07 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Took 0.46 seconds to deallocate network for instance.
Nov 29 23:48:07 user nova-compute[75244]: DEBUG nova.compute.manager [req-d7b6974a-7f20-4532-bd4b-cf439ed6173c req-3e976b36-8534-40bb-b9e6-8c058a304241 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-vif-deleted-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:08 user nova-compute[75244]: INFO nova.compute.manager [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 23:48:08 user nova-compute[75244]: DEBUG nova.compute.manager [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Deleting volume: 057eed0c-e7a3-44ff-849c-cf70e6796384 {{(pid=75244) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-b88e2ce6-23ce-4bd3-9cc6-070a73fee7b1 req-f5ef4550-4ee8-470c-8895-31bea860b322 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received event network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b88e2ce6-23ce-4bd3-9cc6-070a73fee7b1 req-f5ef4550-4ee8-470c-8895-31bea860b322 service nova] Acquiring lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b88e2ce6-23ce-4bd3-9cc6-070a73fee7b1 req-f5ef4550-4ee8-470c-8895-31bea860b322 service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b88e2ce6-23ce-4bd3-9cc6-070a73fee7b1 req-f5ef4550-4ee8-470c-8895-31bea860b322 service nova] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG nova.compute.manager [req-b88e2ce6-23ce-4bd3-9cc6-070a73fee7b1 req-f5ef4550-4ee8-470c-8895-31bea860b322 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] No waiting events found dispatching network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:48:08 user nova-compute[75244]: WARNING nova.compute.manager [req-b88e2ce6-23ce-4bd3-9cc6-070a73fee7b1 req-f5ef4550-4ee8-470c-8895-31bea860b322 service nova] [instance: 2337bf9a-d4fb-491b-81c3-5de716ec30c1] Received unexpected event network-vif-plugged-b3be6c3f-a066-416e-9e1b-82901aef5684 for instance with vm_state active and task_state deleting.
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:08 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Deleted allocations for instance 2337bf9a-d4fb-491b-81c3-5de716ec30c1
Nov 29 23:48:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-520c9db4-df73-420d-8d0e-f078dd70eff0 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "2337bf9a-d4fb-491b-81c3-5de716ec30c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:48:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:48:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:48:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:48:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:48:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:48:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:48:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:48:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:48:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:48:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:48:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:48:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:48:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:48:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:48:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:48:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:48:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:49:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:49:05 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:49:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=25.020572662353516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:49:05 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:49:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "5070e4a2-b391-489f-a991-4025dee7a518" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:49:13 user nova-compute[75244]: INFO nova.compute.claims [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Claim successful on node user
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.179s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:49:13 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.policy [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5ff1ce050ce4d3eb6beacb200c31c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6184f3bb14443693af3012edc107b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:49:13 user nova-compute[75244]: INFO nova.virt.block_device [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Booting with volume 15330017-e154-4495-8f72-49c03f65b97a at /dev/vda
Nov 29 23:49:13 user nova-compute[75244]: DEBUG os_brick.utils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0e9ca-d999-4aa7-b289-699381df0173]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8e114-520f-466c-ba0e-beaa55927c47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f684e3d-010c-4986-abe4-86b2cc2ec3d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d01017-90fe-4225-9773-b571b40ee2cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:49:13 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:49:13 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[543093da-18f7-49c0-84d3-6015b210775b]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG os_brick.utils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:49:13 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating existing volume attachment record: a72514a9-2c16-448d-89b7-c1b79605ba8d {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Successfully created port: 7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Skipping network cache update for instance because it is Building. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Successfully updated port: 7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquired lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-changed-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG nova.compute.manager [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Refreshing instance network info cache due to event network-changed-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:49:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] Acquiring lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Releasing lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Instance network_info: |[{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] Acquired lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Refreshing network info cache for port 7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updated VIF entry in instance network info cache for port 7e2c5bb2-1cb6-4f89-81d2-66e47c694aae. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG nova.network.neutron [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:49:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4a8d9fc7-31af-4738-8bb2-73709db51292 req-a8cdc347-48dd-43ed-bb1e-da7e3c61863e service nova] Releasing lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:49:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:49:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:49:21 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Creating image(s)
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Ensure instance console log exists: /opt/stack/data/nova/instances/5070e4a2-b391-489f-a991-4025dee7a518/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Start _get_guest_xml network_info=[{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFshAwLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5070e4a2-b391-489f-a991-4025dee7a518', 'attached_at': '', 'detached_at': '', 'volume_id': '15330017-e154-4495-8f72-49c03f65b97a', 'serial': '15330017-e154-4495-8f72-49c03f65b97a'}, 'attachment_id': 'a72514a9-2c16-448d-89b7-c1b79605ba8d', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:49:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:49:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFshAwLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:49:21 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:49:21 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:49:21 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730c7a3-ed88-4a4a-829d-5217cc47712e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:49:21 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae334ab8-378e-4c9b-a244-6b50a62f39c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a] added
Nov 29 23:49:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8607c382-0a6c-42de-8415-b1deb1443dda]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec34f949-4c6f-4d9e-abca-5f7ecec514d1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFshAwLG {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFshAwLG" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2057434d-e41a-423d-97a6-e2cc63a796ac]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFshAwLG'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7525de9e-ac78-4235-8215-39319357f341]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b82bd2-0341-43ba-b72f-1e921f8bb320]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:49:21 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:49:21 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:49:21 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:49:21 user nova-compute[75244]: 
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9bfb03-6f05-451d-82cd-0f3fbb0f3d54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260]
Nov 29 23:49:21 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260] successful.
Nov 29 23:49:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb499ab-87e1-4fd2-999c-6315b9164810]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abba7db-0539-49e9-a79c-a354b95aebbf]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:49:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:49:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfe6b41-a872-4828-a6e1-d3f72207e933]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFshAwLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:49:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26365313739323638', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365313739323638', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2108892333',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2108892333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2108892333',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Oamik7ECf2s2WuD4UayyNQZaT0L3sYaOQTqksO/iiGV+D2HDrtcKQoENCEok1YyUMyHuFWeb/o7coFq2lOJpRJybwdUkKXloAYWN2D97kHrB4YH0Frd/+c9oYwUERrQ==',key_name='tempest-keypair-803740629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-zg0asihi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=5070e4a2-b391-489f-a991-4025dee7a518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'pci_devices' on Instance uuid 5070e4a2-b391-489f-a991-4025dee7a518 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:49:22 user nova-compute[75244]:   <uuid>5070e4a2-b391-489f-a991-4025dee7a518</uuid>
Nov 29 23:49:22 user nova-compute[75244]:   <name>instance-00000030</name>
Nov 29 23:49:22 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:49:22 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:49:22 user nova-compute[75244]:   <metadata>
Nov 29 23:49:22 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:49:22 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:49:22 user nova-compute[75244]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2108892333</nova:name>
Nov 29 23:49:22 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:49:21</nova:creationTime>
Nov 29 23:49:22 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:49:22 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:49:22 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:49:22 user nova-compute[75244]:       <nova:owner>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:user uuid="d5ff1ce050ce4d3eb6beacb200c31c16">tempest-TestVolumeBootPattern-1146673908-project-member</nova:user>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:project uuid="4c6184f3bb14443693af3012edc107b0">tempest-TestVolumeBootPattern-1146673908</nova:project>
Nov 29 23:49:22 user nova-compute[75244]:       </nova:owner>
Nov 29 23:49:22 user nova-compute[75244]:       <nova:ports>
Nov 29 23:49:22 user nova-compute[75244]:         <nova:port uuid="7e2c5bb2-1cb6-4f89-81d2-66e47c694aae">
Nov 29 23:49:22 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:49:22 user nova-compute[75244]:         </nova:port>
Nov 29 23:49:22 user nova-compute[75244]:       </nova:ports>
Nov 29 23:49:22 user nova-compute[75244]:     </nova:instance>
Nov 29 23:49:22 user nova-compute[75244]:   </metadata>
Nov 29 23:49:22 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:49:22 user nova-compute[75244]:     <system>
Nov 29 23:49:22 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:49:22 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:49:22 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:49:22 user nova-compute[75244]:       <entry name="serial">5070e4a2-b391-489f-a991-4025dee7a518</entry>
Nov 29 23:49:22 user nova-compute[75244]:       <entry name="uuid">5070e4a2-b391-489f-a991-4025dee7a518</entry>
Nov 29 23:49:22 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:49:22 user nova-compute[75244]:     </system>
Nov 29 23:49:22 user nova-compute[75244]:   </sysinfo>
Nov 29 23:49:22 user nova-compute[75244]:   <os>
Nov 29 23:49:22 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:49:22 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:49:22 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:49:22 user nova-compute[75244]:   </os>
Nov 29 23:49:22 user nova-compute[75244]:   <features>
Nov 29 23:49:22 user nova-compute[75244]:     <acpi/>
Nov 29 23:49:22 user nova-compute[75244]:     <apic/>
Nov 29 23:49:22 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:49:22 user nova-compute[75244]:   </features>
Nov 29 23:49:22 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:49:22 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:49:22 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:49:22 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:49:22 user nova-compute[75244]:   </clock>
Nov 29 23:49:22 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:49:22 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:49:22 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:49:22 user nova-compute[75244]:   </cpu>
Nov 29 23:49:22 user nova-compute[75244]:   <devices>
Nov 29 23:49:22 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:49:22 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:49:22 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:49:22 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:49:22 user nova-compute[75244]:       <serial>15330017-e154-4495-8f72-49c03f65b97a</serial>
Nov 29 23:49:22 user nova-compute[75244]:     </disk>
Nov 29 23:49:22 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:49:22 user nova-compute[75244]:       <mac address="fa:16:3e:c3:d5:14"/>
Nov 29 23:49:22 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:49:22 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:49:22 user nova-compute[75244]:       <target dev="tap7e2c5bb2-1c"/>
Nov 29 23:49:22 user nova-compute[75244]:     </interface>
Nov 29 23:49:22 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:49:22 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/5070e4a2-b391-489f-a991-4025dee7a518/console.log" append="off"/>
Nov 29 23:49:22 user nova-compute[75244]:     </serial>
Nov 29 23:49:22 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:49:22 user nova-compute[75244]:     <video>
Nov 29 23:49:22 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:49:22 user nova-compute[75244]:     </video>
Nov 29 23:49:22 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:49:22 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:49:22 user nova-compute[75244]:     </rng>
Nov 29 23:49:22 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:49:22 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:49:22 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:49:22 user nova-compute[75244]:     </memballoon>
Nov 29 23:49:22 user nova-compute[75244]:   </devices>
Nov 29 23:49:22 user nova-compute[75244]: </domain>
Nov 29 23:49:22 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2108892333',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2108892333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2108892333',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Oamik7ECf2s2WuD4UayyNQZaT0L3sYaOQTqksO/iiGV+D2HDrtcKQoENCEok1YyUMyHuFWeb/o7coFq2lOJpRJybwdUkKXloAYWN2D97kHrB4YH0Frd/+c9oYwUERrQ==',key_name='tempest-keypair-803740629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-zg0asihi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=5070e4a2-b391-489f-a991-4025dee7a518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG os_vif [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b0abe52-d208-5bf2-af6b-d5886a6a1606', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e2c5bb2-1c, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e2c5bb2-1c, col_values=(('qos', UUID('26c63db1-12a9-4d73-9277-66ba41f4e387')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e2c5bb2-1c, col_values=(('external_ids', {'iface-id': '7e2c5bb2-1cb6-4f89-81d2-66e47c694aae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:d5:14', 'vm-uuid': '5070e4a2-b391-489f-a991-4025dee7a518'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:22 user nova-compute[75244]: INFO os_vif [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c')
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:49:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No VIF found with MAC fa:16:3e:c3:d5:14, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc73378e-650a-4c32-bee4-1f5e2d083f59 req-ab42092e-23dc-41f8-9204-b7b726cf31f5 service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc73378e-650a-4c32-bee4-1f5e2d083f59 req-ab42092e-23dc-41f8-9204-b7b726cf31f5 service nova] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc73378e-650a-4c32-bee4-1f5e2d083f59 req-ab42092e-23dc-41f8-9204-b7b726cf31f5 service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-bc73378e-650a-4c32-bee4-1f5e2d083f59 req-ab42092e-23dc-41f8-9204-b7b726cf31f5 service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-bc73378e-650a-4c32-bee4-1f5e2d083f59 req-ab42092e-23dc-41f8-9204-b7b726cf31f5 service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] No waiting events found dispatching network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:49:23 user nova-compute[75244]: WARNING nova.compute.manager [req-bc73378e-650a-4c32-bee4-1f5e2d083f59 req-ab42092e-23dc-41f8-9204-b7b726cf31f5 service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received unexpected event network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae for instance with vm_state building and task_state spawning.
Nov 29 23:49:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-887cad7a-6176-4821-a854-ccaddfb2802b req-e9854b29-7e01-493e-9c3a-55877514fce1 service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-887cad7a-6176-4821-a854-ccaddfb2802b req-e9854b29-7e01-493e-9c3a-55877514fce1 service nova] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-887cad7a-6176-4821-a854-ccaddfb2802b req-e9854b29-7e01-493e-9c3a-55877514fce1 service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-887cad7a-6176-4821-a854-ccaddfb2802b req-e9854b29-7e01-493e-9c3a-55877514fce1 service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:25 user nova-compute[75244]: DEBUG nova.compute.manager [req-887cad7a-6176-4821-a854-ccaddfb2802b req-e9854b29-7e01-493e-9c3a-55877514fce1 service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] No waiting events found dispatching network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:49:25 user nova-compute[75244]: WARNING nova.compute.manager [req-887cad7a-6176-4821-a854-ccaddfb2802b req-e9854b29-7e01-493e-9c3a-55877514fce1 service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received unexpected event network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae for instance with vm_state building and task_state spawning.
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:49:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Instance spawned successfully.
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:49:26 user nova-compute[75244]: INFO nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 29 23:49:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:49:26 user nova-compute[75244]: INFO nova.compute.manager [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Took 13.05 seconds to build instance.
Nov 29 23:49:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-0800314f-8271-42b8-8c47-3e8c7befb235 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "5070e4a2-b391-489f-a991-4025dee7a518" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.206s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:49:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:49:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:49:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:50:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:50:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:50:07 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.01873779296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5070e4a2-b391-489f-a991-4025dee7a518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:50:07 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:50:08 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:50:08 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:50:08 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:50:08 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:50:10 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 5070e4a2-b391-489f-a991-4025dee7a518 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:50:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:50:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:50:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:50:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:50:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:50:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:50:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-changed-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG nova.compute.manager [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Refreshing instance network info cache due to event network-changed-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] Acquiring lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] Acquired lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG nova.network.neutron [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Refreshing network info cache for port 7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG nova.network.neutron [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updated VIF entry in instance network info cache for port 7e2c5bb2-1cb6-4f89-81d2-66e47c694aae. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG nova.network.neutron [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:51:04 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-23467ba1-5db8-4dea-b4fc-d96245d01998 req-d4d6f47d-4fd2-411d-86ea-ce5c8606db2d service nova] Releasing lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:51:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:51:09 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.017959594726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5070e4a2-b391-489f-a991-4025dee7a518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:51:09 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:11 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:51:11 user nova-compute[75244]: INFO nova.compute.claims [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Claim successful on node user
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:51:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:51:12 user nova-compute[75244]: INFO nova.virt.block_device [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Booting with volume snapshot 63062757-62d3-48bc-841a-ef61e41aa999 at /dev/vda
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.policy [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5ff1ce050ce4d3eb6beacb200c31c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6184f3bb14443693af3012edc107b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:12 user nova-compute[75244]: DEBUG nova.network.neutron [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Successfully created port: 91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Successfully updated port: 91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquired lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-changed-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.compute.manager [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Refreshing instance network info cache due to event network-changed-91e8f8e0-83f3-4e2a-b504-762165b9a0e1. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] Acquiring lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.network.neutron [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updating instance_info_cache with network_info: [{"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Releasing lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Instance network_info: |[{"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] Acquired lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG nova.network.neutron [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Refreshing network info cache for port 91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:51:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updated VIF entry in instance network info cache for port 91e8f8e0-83f3-4e2a-b504-762165b9a0e1. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:51:14 user nova-compute[75244]: DEBUG nova.network.neutron [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updating instance_info_cache with network_info: [{"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:51:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3723eb59-3158-4b3b-ad20-e8fa6d9b44ee req-27825496-24d7-4ca8-be95-cbda45e6bd2e service nova] Releasing lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Skipping network cache update for instance because it is Building. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 5070e4a2-b391-489f-a991-4025dee7a518 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:51:15 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:51:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG os_brick.utils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb151b-01dd-4495-8f48-5fa50b9d9189]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca07173-9636-4163-beee-3bb5146ac62d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[791aa833-9e41-42a4-908b-3d73d8060576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f44980-8c49-467c-bc88-37423997907b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:51:18 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:51:18 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4e305a-fbd2-4a68-8459-b086425988dc]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG os_brick.utils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== get_connector_properties: return (304ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:51:18 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updating existing volume attachment record: eb7d2b34-1cef-4155-b116-bf761cc3dd3c {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:51:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:51:26 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Creating image(s)
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Ensure instance console log exists: /opt/stack/data/nova/instances/a99d16b2-b287-4e5c-a43b-2c47d4c67f43/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Start _get_guest_xml network_info=[{"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T23:51:06Z,direct_url=<?>,disk_format='qcow2',id=54d8d45c-4adb-4366-909c-e8082cb081c5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1224603907',owner='4c6184f3bb14443693af3012edc107b0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T23:51:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTGgdFcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a99d16b2-b287-4e5c-a43b-2c47d4c67f43', 'attached_at': '', 'detached_at': '', 'volume_id': 'cde0df47-656c-4444-b7b7-a936406d1c8b', 'serial': 'cde0df47-656c-4444-b7b7-a936406d1c8b'}, 'attachment_id': 'eb7d2b34-1cef-4155-b116-bf761cc3dd3c', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:51:26 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:51:26 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T23:51:06Z,direct_url=<?>,disk_format='qcow2',id=54d8d45c-4adb-4366-909c-e8082cb081c5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1224603907',owner='4c6184f3bb14443693af3012edc107b0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T23:51:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTGgdFcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:51:26 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:51:26 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:51:26 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6576445-ea0f-4f39-b62d-ce0b24e25270]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:51:26 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c174ce-e09f-47ee-8e0b-6211ee4dae7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b] added
Nov 29 23:51:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f1a41-d317-4dcb-8fcf-6b195957e3e1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[62913b61-0b4c-44df-9078-d08850528de3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uTGgdFcZ {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uTGgdFcZ" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa42bc-9118-4401-9b95-8aef2f410805]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uTGgdFcZ'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefad907-96af-4df5-b8b6-a54dc309c741]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[200bc852-92d4-43d5-a42e-66a92f84679d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:51:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:51:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c9e28-a96e-4b5b-94ca-4611698b1919]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260]
Nov 29 23:51:26 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260] successful.
Nov 29 23:51:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d3bcb-0d04-47b0-9be9-6fd810eaa996]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0bffd9-8e5b-4872-b827-d695c9729e3a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:51:26 user nova-compute[75244]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b (non-flash)
Nov 29 23:51:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:51:26 user nova-compute[75244]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b (non-flash)
Nov 29 23:51:26 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a6d5c2-d7d2-4753-a94e-2370fcf9f766]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:51:26 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTGgdFcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23034326337323366', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034326337323366', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-326361534',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-326361534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-326361534',id=49,image_ref='54d8d45c-4adb-4366-909c-e8082cb081c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoYAtJZIJzS+lA1okx6q+V+ZYTDEoikgEvq/SMQiW6jZpkxJYblMK0eZmiyeU4o6oRKIt8EUh5AE2CcLOptWKFOUaaLUsY+s+4BvFEVZWdK54pXjtYRSLefhU93tlCbpA==',key_name='tempest-keypair-1351514942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-yzuw8h7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1146673908',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:51:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=a99d16b2-b287-4e5c-a43b-2c47d4c67f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'pci_devices' on Instance uuid a99d16b2-b287-4e5c-a43b-2c47d4c67f43 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:51:27 user nova-compute[75244]:   <uuid>a99d16b2-b287-4e5c-a43b-2c47d4c67f43</uuid>
Nov 29 23:51:27 user nova-compute[75244]:   <name>instance-00000031</name>
Nov 29 23:51:27 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:51:27 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:51:27 user nova-compute[75244]:   <metadata>
Nov 29 23:51:27 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:51:27 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:51:27 user nova-compute[75244]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-326361534</nova:name>
Nov 29 23:51:27 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:51:26</nova:creationTime>
Nov 29 23:51:27 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:51:27 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:51:27 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:51:27 user nova-compute[75244]:       <nova:owner>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:user uuid="d5ff1ce050ce4d3eb6beacb200c31c16">tempest-TestVolumeBootPattern-1146673908-project-member</nova:user>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:project uuid="4c6184f3bb14443693af3012edc107b0">tempest-TestVolumeBootPattern-1146673908</nova:project>
Nov 29 23:51:27 user nova-compute[75244]:       </nova:owner>
Nov 29 23:51:27 user nova-compute[75244]:       <nova:root type="image" uuid="54d8d45c-4adb-4366-909c-e8082cb081c5"/>
Nov 29 23:51:27 user nova-compute[75244]:       <nova:ports>
Nov 29 23:51:27 user nova-compute[75244]:         <nova:port uuid="91e8f8e0-83f3-4e2a-b504-762165b9a0e1">
Nov 29 23:51:27 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 23:51:27 user nova-compute[75244]:         </nova:port>
Nov 29 23:51:27 user nova-compute[75244]:       </nova:ports>
Nov 29 23:51:27 user nova-compute[75244]:     </nova:instance>
Nov 29 23:51:27 user nova-compute[75244]:   </metadata>
Nov 29 23:51:27 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:51:27 user nova-compute[75244]:     <system>
Nov 29 23:51:27 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:51:27 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:51:27 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:51:27 user nova-compute[75244]:       <entry name="serial">a99d16b2-b287-4e5c-a43b-2c47d4c67f43</entry>
Nov 29 23:51:27 user nova-compute[75244]:       <entry name="uuid">a99d16b2-b287-4e5c-a43b-2c47d4c67f43</entry>
Nov 29 23:51:27 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:51:27 user nova-compute[75244]:     </system>
Nov 29 23:51:27 user nova-compute[75244]:   </sysinfo>
Nov 29 23:51:27 user nova-compute[75244]:   <os>
Nov 29 23:51:27 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:51:27 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:51:27 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:51:27 user nova-compute[75244]:   </os>
Nov 29 23:51:27 user nova-compute[75244]:   <features>
Nov 29 23:51:27 user nova-compute[75244]:     <acpi/>
Nov 29 23:51:27 user nova-compute[75244]:     <apic/>
Nov 29 23:51:27 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:51:27 user nova-compute[75244]:   </features>
Nov 29 23:51:27 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:51:27 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:51:27 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:51:27 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:51:27 user nova-compute[75244]:   </clock>
Nov 29 23:51:27 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:51:27 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:51:27 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:51:27 user nova-compute[75244]:   </cpu>
Nov 29 23:51:27 user nova-compute[75244]:   <devices>
Nov 29 23:51:27 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:51:27 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:51:27 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:51:27 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:51:27 user nova-compute[75244]:       <serial>cde0df47-656c-4444-b7b7-a936406d1c8b</serial>
Nov 29 23:51:27 user nova-compute[75244]:     </disk>
Nov 29 23:51:27 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:51:27 user nova-compute[75244]:       <mac address="fa:16:3e:7d:16:9a"/>
Nov 29 23:51:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:51:27 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:51:27 user nova-compute[75244]:       <target dev="tap91e8f8e0-83"/>
Nov 29 23:51:27 user nova-compute[75244]:     </interface>
Nov 29 23:51:27 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:51:27 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/a99d16b2-b287-4e5c-a43b-2c47d4c67f43/console.log" append="off"/>
Nov 29 23:51:27 user nova-compute[75244]:     </serial>
Nov 29 23:51:27 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:51:27 user nova-compute[75244]:     <video>
Nov 29 23:51:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:51:27 user nova-compute[75244]:     </video>
Nov 29 23:51:27 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:51:27 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:51:27 user nova-compute[75244]:     </rng>
Nov 29 23:51:27 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:51:27 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:51:27 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:51:27 user nova-compute[75244]:     </memballoon>
Nov 29 23:51:27 user nova-compute[75244]:   </devices>
Nov 29 23:51:27 user nova-compute[75244]: </domain>
Nov 29 23:51:27 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-326361534',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-326361534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-326361534',id=49,image_ref='54d8d45c-4adb-4366-909c-e8082cb081c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoYAtJZIJzS+lA1okx6q+V+ZYTDEoikgEvq/SMQiW6jZpkxJYblMK0eZmiyeU4o6oRKIt8EUh5AE2CcLOptWKFOUaaLUsY+s+4BvFEVZWdK54pXjtYRSLefhU93tlCbpA==',key_name='tempest-keypair-1351514942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-yzuw8h7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1146673908',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:51:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=a99d16b2-b287-4e5c-a43b-2c47d4c67f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG os_vif [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7903c52-7fdf-578d-a67f-a15021c8c6cf', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91e8f8e0-83, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91e8f8e0-83, col_values=(('qos', UUID('1223f0bc-5186-482b-8d0c-dd34d9bd8506')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91e8f8e0-83, col_values=(('external_ids', {'iface-id': '91e8f8e0-83f3-4e2a-b504-762165b9a0e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:16:9a', 'vm-uuid': 'a99d16b2-b287-4e5c-a43b-2c47d4c67f43'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:27 user nova-compute[75244]: INFO os_vif [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83')
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:51:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No VIF found with MAC fa:16:3e:7d:16:9a, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:51:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:51:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-4ac2209e-1093-4ae3-823e-d320bfcb9808 req-28190004-1b03-4a2e-aa01-cac5424a419c service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:51:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4ac2209e-1093-4ae3-823e-d320bfcb9808 req-28190004-1b03-4a2e-aa01-cac5424a419c service nova] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4ac2209e-1093-4ae3-823e-d320bfcb9808 req-28190004-1b03-4a2e-aa01-cac5424a419c service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-4ac2209e-1093-4ae3-823e-d320bfcb9808 req-28190004-1b03-4a2e-aa01-cac5424a419c service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:29 user nova-compute[75244]: DEBUG nova.compute.manager [req-4ac2209e-1093-4ae3-823e-d320bfcb9808 req-28190004-1b03-4a2e-aa01-cac5424a419c service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] No waiting events found dispatching network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:51:29 user nova-compute[75244]: WARNING nova.compute.manager [req-4ac2209e-1093-4ae3-823e-d320bfcb9808 req-28190004-1b03-4a2e-aa01-cac5424a419c service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received unexpected event network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 for instance with vm_state building and task_state spawning.
Nov 29 23:51:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:51:31 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Instance spawned successfully.
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-f03c64f0-9f33-40ce-b61c-c2fad66ab43b req-c4f4f45d-a550-4c07-a9d2-17adbff7da25 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f03c64f0-9f33-40ce-b61c-c2fad66ab43b req-c4f4f45d-a550-4c07-a9d2-17adbff7da25 service nova] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f03c64f0-9f33-40ce-b61c-c2fad66ab43b req-c4f4f45d-a550-4c07-a9d2-17adbff7da25 service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f03c64f0-9f33-40ce-b61c-c2fad66ab43b req-c4f4f45d-a550-4c07-a9d2-17adbff7da25 service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.compute.manager [req-f03c64f0-9f33-40ce-b61c-c2fad66ab43b req-c4f4f45d-a550-4c07-a9d2-17adbff7da25 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] No waiting events found dispatching network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:51:31 user nova-compute[75244]: WARNING nova.compute.manager [req-f03c64f0-9f33-40ce-b61c-c2fad66ab43b req-c4f4f45d-a550-4c07-a9d2-17adbff7da25 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received unexpected event network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 for instance with vm_state building and task_state spawning.
Nov 29 23:51:31 user nova-compute[75244]: INFO nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 29 23:51:31 user nova-compute[75244]: DEBUG nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:51:31 user nova-compute[75244]: INFO nova.compute.manager [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Took 19.36 seconds to build instance.
Nov 29 23:51:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-465a9492-7a83-4ba5-9a81-1249ee485920 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.450s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:51:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:51:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:11 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:52:11 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=25.016098022460938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5070e4a2-b391-489f-a991-4025dee7a518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance a99d16b2-b287-4e5c-a43b-2c47d4c67f43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:52:11 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:52:12 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:52:12 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:52:12 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:52:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:52:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 5070e4a2-b391-489f-a991-4025dee7a518 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [{"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-5070e4a2-b391-489f-a991-4025dee7a518" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:52:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:52:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:52:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:52:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:52:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:52:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:52:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:52:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:52:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:52:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:52:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:52:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-changed-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG nova.compute.manager [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Refreshing instance network info cache due to event network-changed-91e8f8e0-83f3-4e2a-b504-762165b9a0e1. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] Acquiring lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] Acquired lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Refreshing network info cache for port 91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updated VIF entry in instance network info cache for port 91e8f8e0-83f3-4e2a-b504-762165b9a0e1. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG nova.network.neutron [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updating instance_info_cache with network_info: [{"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b087de84-fee0-40d7-9ac3-d57edad4bd96 req-dbd57f17-bb0e-447a-848f-db458e1941cb service nova] Releasing lock "refresh_cache-a99d16b2-b287-4e5c-a43b-2c47d4c67f43" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:03 user nova-compute[75244]: INFO nova.compute.manager [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Terminating instance
Nov 29 23:53:03 user nova-compute[75244]: DEBUG nova.compute.manager [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Instance destroyed successfully.
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.objects.instance [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'resources' on Instance uuid a99d16b2-b287-4e5c-a43b-2c47d4c67f43 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-326361534',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-326361534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-326361534',id=49,image_ref='54d8d45c-4adb-4366-909c-e8082cb081c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoYAtJZIJzS+lA1okx6q+V+ZYTDEoikgEvq/SMQiW6jZpkxJYblMK0eZmiyeU4o6oRKIt8EUh5AE2CcLOptWKFOUaaLUsY+s+4BvFEVZWdK54pXjtYRSLefhU93tlCbpA==',key_name='tempest-keypair-1351514942',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-yzuw8h7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1146673908',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:51:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=a99d16b2-b287-4e5c-a43b-2c47d4c67f43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "address": "fa:16:3e:7d:16:9a", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e8f8e0-83", "ovs_interfaceid": "91e8f8e0-83f3-4e2a-b504-762165b9a0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_vif [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91e8f8e0-83, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1223f0bc-5186-482b-8d0c-dd34d9bd8506) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:04 user nova-compute[75244]: INFO os_vif [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:16:9a,bridge_name='br-int',has_traffic_filtering=True,id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e8f8e0-83')
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTGgdFcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:53:04 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad88ce4-d2d8-4dad-8a9e-6b387e81d856]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:53:04 user nova-compute[75244]: No targets found.
Nov 29 23:53:04 user nova-compute[75244]: iSNS:
Nov 29 23:53:04 user nova-compute[75244]: No targets found.
Nov 29 23:53:04 user nova-compute[75244]: STATIC:
Nov 29 23:53:04 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b
Nov 29 23:53:04 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:53:04 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:53:04 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a
Nov 29 23:53:04 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:53:04 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:53:04 user nova-compute[75244]: FIRMWARE:
Nov 29 23:53:04 user nova-compute[75244]: No targets found.
Nov 29 23:53:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:53:04 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:53:04 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9fa95f-6118-4499-899c-5031d46ba24c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d3322-180d-4f90-930a-957d50a26bce]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:53:04 user nova-compute[75244]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b (non-flash)
Nov 29 23:53:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:53:04 user nova-compute[75244]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b (non-flash)
Nov 29 23:53:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804201a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb8011-a976-46c9-a8c8-bb9f8f771a69]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f6485f-ec24-4169-acd2-9b3422e5b2ee]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d482e-d43a-4bcf-b2a7-b0484db041d6]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[522192af-46eb-4085-93b5-7772f453a2e3]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23034326337323366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6586ee3', '/dev/disk/by-id/scsi-1SCST_BIOf6586ee3-042c723f251d3c81') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac961253-2def-4163-ba99-1d0a80efc40e]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc2d1c-913f-4938-bec8-ec321daf5294]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[354fab06-2240-4473-9aaa-335e6bab289c]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260]
Nov 29 23:53:04 user nova-compute[75244]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b, portal: 172.16.0.220,3260] successful.
Nov 29 23:53:04 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde0df47-656c-4444-b7b7-a936406d1c8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[40209702-a483-4076-bc3f-388c2bf0d93a]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== disconnect_volume: return (284ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:53:04 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Deleting instance files /opt/stack/data/nova/instances/a99d16b2-b287-4e5c-a43b-2c47d4c67f43_del
Nov 29 23:53:04 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Deletion of /opt/stack/data/nova/instances/a99d16b2-b287-4e5c-a43b-2c47d4c67f43_del complete
Nov 29 23:53:04 user nova-compute[75244]: INFO nova.compute.manager [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 29 23:53:04 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:53:04 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-vif-unplugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] No waiting events found dispatching network-vif-unplugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-vif-unplugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] Acquiring lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] No waiting events found dispatching network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:53:05 user nova-compute[75244]: WARNING nova.compute.manager [req-9f338e77-73e1-47d5-b3a8-27eaa0e15649 req-324dc4ca-b311-4935-90a8-604b5e591fd1 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received unexpected event network-vif-plugged-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 for instance with vm_state active and task_state deleting.
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:53:05 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Took 1.10 seconds to deallocate network for instance.
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-14b81fda-5e21-456b-8579-eecd8e270d3b req-53235cc0-dbb3-4ed4-a652-abcd004ceee0 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Received event network-vif-deleted-91e8f8e0-83f3-4e2a-b504-762165b9a0e1 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:53:05 user nova-compute[75244]: INFO nova.compute.manager [req-14b81fda-5e21-456b-8579-eecd8e270d3b req-53235cc0-dbb3-4ed4-a652-abcd004ceee0 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Neutron deleted interface 91e8f8e0-83f3-4e2a-b504-762165b9a0e1; detaching it from the instance and deleting it from the info cache
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.network.neutron [req-14b81fda-5e21-456b-8579-eecd8e270d3b req-53235cc0-dbb3-4ed4-a652-abcd004ceee0 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:53:05 user nova-compute[75244]: DEBUG nova.compute.manager [req-14b81fda-5e21-456b-8579-eecd8e270d3b req-53235cc0-dbb3-4ed4-a652-abcd004ceee0 service nova] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Detach interface failed, port_id=91e8f8e0-83f3-4e2a-b504-762165b9a0e1, reason: Instance a99d16b2-b287-4e5c-a43b-2c47d4c67f43 could not be found. {{(pid=75244) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 23:53:06 user nova-compute[75244]: INFO nova.compute.manager [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Took 0.78 seconds to detach 1 volumes for instance.
Nov 29 23:53:06 user nova-compute[75244]: DEBUG nova.compute.manager [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: a99d16b2-b287-4e5c-a43b-2c47d4c67f43] Deleting volume: cde0df47-656c-4444-b7b7-a936406d1c8b {{(pid=75244) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 23:53:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:06 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:53:06 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:53:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:06 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Deleted allocations for instance a99d16b2-b287-4e5c-a43b-2c47d4c67f43
Nov 29 23:53:06 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-46743bcb-e156-42e5-8199-660f12b2d65b tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "a99d16b2-b287-4e5c-a43b-2c47d4c67f43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.423s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:12 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:53:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:53:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.01525115966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 5070e4a2-b391-489f-a991-4025dee7a518 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:53:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:53:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:53:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:53:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:53:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:53:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:53:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:23 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:32 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:53:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:53:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:53:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:53:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:53:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:53:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:53:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "5070e4a2-b391-489f-a991-4025dee7a518" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:58 user nova-compute[75244]: INFO nova.compute.manager [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Terminating instance
Nov 29 23:53:58 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-f16abe7f-f50b-4348-93bf-f3bdf22b8bc5 req-22a096ed-d3d4-48f1-bf18-bd145e3042ce service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-vif-unplugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f16abe7f-f50b-4348-93bf-f3bdf22b8bc5 req-22a096ed-d3d4-48f1-bf18-bd145e3042ce service nova] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f16abe7f-f50b-4348-93bf-f3bdf22b8bc5 req-22a096ed-d3d4-48f1-bf18-bd145e3042ce service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f16abe7f-f50b-4348-93bf-f3bdf22b8bc5 req-22a096ed-d3d4-48f1-bf18-bd145e3042ce service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-f16abe7f-f50b-4348-93bf-f3bdf22b8bc5 req-22a096ed-d3d4-48f1-bf18-bd145e3042ce service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] No waiting events found dispatching network-vif-unplugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:53:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-f16abe7f-f50b-4348-93bf-f3bdf22b8bc5 req-22a096ed-d3d4-48f1-bf18-bd145e3042ce service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-vif-unplugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:53:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Instance destroyed successfully.
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'resources' on Instance uuid 5070e4a2-b391-489f-a991-4025dee7a518 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2108892333',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2108892333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2108892333',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Oamik7ECf2s2WuD4UayyNQZaT0L3sYaOQTqksO/iiGV+D2HDrtcKQoENCEok1YyUMyHuFWeb/o7coFq2lOJpRJybwdUkKXloAYWN2D97kHrB4YH0Frd/+c9oYwUERrQ==',key_name='tempest-keypair-803740629',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-zg0asihi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=5070e4a2-b391-489f-a991-4025dee7a518,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "address": "fa:16:3e:c3:d5:14", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2c5bb2-1c", "ovs_interfaceid": "7e2c5bb2-1cb6-4f89-81d2-66e47c694aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_vif [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e2c5bb2-1c, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26c63db1-12a9-4d73-9277-66ba41f4e387) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:53:59 user nova-compute[75244]: INFO os_vif [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:d5:14,bridge_name='br-int',has_traffic_filtering=True,id=7e2c5bb2-1cb6-4f89-81d2-66e47c694aae,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2c5bb2-1c')
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFshAwLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:53:59 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[104369dd-93ec-4ffa-b30e-ca70147915a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:53:59 user nova-compute[75244]: No targets found.
Nov 29 23:53:59 user nova-compute[75244]: iSNS:
Nov 29 23:53:59 user nova-compute[75244]: No targets found.
Nov 29 23:53:59 user nova-compute[75244]: STATIC:
Nov 29 23:53:59 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a
Nov 29 23:53:59 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:53:59 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:53:59 user nova-compute[75244]: FIRMWARE:
Nov 29 23:53:59 user nova-compute[75244]: No targets found.
Nov 29 23:53:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:53:59 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:53:59 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[220aea88-41cc-47f3-8db6-dd4cb7b7c6a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a31d9-6f53-42fa-90d2-25590a1e7550]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:53:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a (non-flash)
Nov 29 23:53:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8042020e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de57d5a-5efa-43bc-9924-63a5d89cbfc3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba15a45-1594-44d3-a593-2dba08a88688]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d8082-e3b5-427a-b496-98376620ad7f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865094b-b576-4f00-8443-3453416b5616]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ce080b9', '/dev/disk/by-id/scsi-26365313739323638', '/dev/disk/by-id/scsi-1SCST_BIO3ce080b9-ce179268c6c0080c') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256452e-12ff-4951-b71a-ac850d74c89a]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.171s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[559af5b5-24ca-4a19-8318-c317b6286279]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa044667-1ac9-46cd-935d-de24ee14b91b]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260]
Nov 29 23:53:59 user nova-compute[75244]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a, portal: 172.16.0.220,3260] successful.
Nov 29 23:53:59 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15330017-e154-4495-8f72-49c03f65b97a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd5d51d-44ad-41ac-bc3b-ad9b6a7a08f4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== disconnect_volume: return (436ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:53:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Deleting instance files /opt/stack/data/nova/instances/5070e4a2-b391-489f-a991-4025dee7a518_del
Nov 29 23:53:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Deletion of /opt/stack/data/nova/instances/5070e4a2-b391-489f-a991-4025dee7a518_del complete
Nov 29 23:53:59 user nova-compute[75244]: INFO nova.compute.manager [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 23:53:59 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:53:59 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:54:00 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:54:00 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Took 0.69 seconds to deallocate network for instance.
Nov 29 23:54:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:54:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] Acquiring lock "5070e4a2-b391-489f-a991-4025dee7a518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:54:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:54:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] Lock "5070e4a2-b391-489f-a991-4025dee7a518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:54:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] No waiting events found dispatching network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:54:00 user nova-compute[75244]: WARNING nova.compute.manager [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received unexpected event network-vif-plugged-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae for instance with vm_state active and task_state deleting.
Nov 29 23:54:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-b8c6ff61-7d37-4b42-9cd6-2238f6773e62 req-aefe1b6d-15b2-4170-9191-79c7591ed70e service nova] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Received event network-vif-deleted-7e2c5bb2-1cb6-4f89-81d2-66e47c694aae {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:54:01 user nova-compute[75244]: INFO nova.compute.manager [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Took 0.81 seconds to detach 1 volumes for instance.
Nov 29 23:54:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 5070e4a2-b391-489f-a991-4025dee7a518] Deleting volume: 15330017-e154-4495-8f72-49c03f65b97a {{(pid=75244) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 23:54:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:54:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:54:01 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:54:01 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:54:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:54:01 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Deleted allocations for instance 5070e4a2-b391-489f-a991-4025dee7a518
Nov 29 23:54:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c91e58ba-8cde-4740-aba9-9472c91bc307 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "5070e4a2-b391-489f-a991-4025dee7a518" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:54:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:54:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:54:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:54:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:54:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:54:13 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9166MB free_disk=25.014453887939453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:54:13 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:54:14 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:54:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:14 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:54:14 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:54:14 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:54:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:54:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:54:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:54:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:54:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:23 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:25 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:34 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:54:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:54:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:54:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:54:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:54:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:54:59 user nova-compute[75244]: INFO nova.compute.claims [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Claim successful on node user
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.network.neutron [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:54:59 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.policy [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5ff1ce050ce4d3eb6beacb200c31c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6184f3bb14443693af3012edc107b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:54:59 user nova-compute[75244]: INFO nova.virt.block_device [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Booting with volume 3c868d84-c0a2-47dd-a115-603de5a34e0f at /dev/vda
Nov 29 23:54:59 user nova-compute[75244]: DEBUG os_brick.utils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf0f7b0-74f2-4150-b409-34ef86f8eb7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ecf7dc-3abf-4044-a4c3-70b53cc80ea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff58cc-e17c-420d-be3b-27d6002e1246]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d84db72-35c6-48f0-959a-0c3e579f496c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:54:59 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:54:59 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69fda5-59d9-4795-b9dd-ae7fdfd87d9f]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG os_brick.utils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:54:59 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating existing volume attachment record: af4dabde-1eee-4063-85b2-6191a8b2f400 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Successfully created port: 9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Successfully updated port: 9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquired lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-changed-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG nova.compute.manager [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Refreshing instance network info cache due to event network-changed-9b26a426-c3e9-440d-8f1f-64613ff0bd4d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] Acquiring lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:55:00 user nova-compute[75244]: DEBUG nova.network.neutron [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG nova.network.neutron [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating instance_info_cache with network_info: [{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Releasing lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Instance network_info: |[{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] Acquired lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG nova.network.neutron [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Refreshing network info cache for port 9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG nova.network.neutron [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updated VIF entry in instance network info cache for port 9b26a426-c3e9-440d-8f1f-64613ff0bd4d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG nova.network.neutron [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating instance_info_cache with network_info: [{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:55:01 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-14cf345b-16ad-414d-849a-648adc753941 req-84a8d61e-497f-4304-88f3-95325a79ecde service nova] Releasing lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:55:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:55:07 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Creating image(s)
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Ensure instance console log exists: /opt/stack/data/nova/instances/6f62f2e1-dbe3-4034-946f-1fee834508dd/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Start _get_guest_xml network_info=[{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f62f2e1-dbe3-4034-946f-1fee834508dd', 'attached_at': '', 'detached_at': '', 'volume_id': '3c868d84-c0a2-47dd-a115-603de5a34e0f', 'serial': '3c868d84-c0a2-47dd-a115-603de5a34e0f'}, 'attachment_id': 'af4dabde-1eee-4063-85b2-6191a8b2f400', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:55:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:55:07 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:55:07 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:55:07 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:55:07 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77b1da-854b-4369-8986-72c3242d15fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:55:07 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ec2ba-e631-4cb6-86b1-b522bc53a320]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f] added
Nov 29 23:55:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff266b-d508-48c5-857f-c24021a44f77]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676d3a4-f9d0-4e4c-9bd1-6d5a95dca855]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqZsFPvV {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqZsFPvV" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6595689-6305-4c57-9392-0d87965fe12f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yqZsFPvV'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce6966-9918-41d0-89d2-df115d6bed33]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b483c04-38c6-49f8-abac-f78ac2e877d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:55:07 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:55:07 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:55:07 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:55:07 user nova-compute[75244]: 
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d896d8-5ca5-4b64-9776-25e3bc8ecf77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]
Nov 29 23:55:07 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.
Nov 29 23:55:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e9be47-f721-4b2e-945a-8a325adadcab]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd7e527-9847-417d-9759-f18afc98d256]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:55:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:55:07 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f5f92-a269-4a9a-b385-69bc92019f0c]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:55:07 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23863386530613633', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863386530613633', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1300045044',display_name='tempest-TestVolumeBootPattern-server-1300045044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1300045044',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-ru85x26a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:55:00Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=6f62f2e1-dbe3-4034-946f-1fee834508dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f62f2e1-dbe3-4034-946f-1fee834508dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:55:08 user nova-compute[75244]:   <uuid>6f62f2e1-dbe3-4034-946f-1fee834508dd</uuid>
Nov 29 23:55:08 user nova-compute[75244]:   <name>instance-00000032</name>
Nov 29 23:55:08 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:55:08 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:55:08 user nova-compute[75244]:   <metadata>
Nov 29 23:55:08 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:55:08 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:55:08 user nova-compute[75244]:       <nova:name>tempest-TestVolumeBootPattern-server-1300045044</nova:name>
Nov 29 23:55:08 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:55:07</nova:creationTime>
Nov 29 23:55:08 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:55:08 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:55:08 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:55:08 user nova-compute[75244]:       <nova:owner>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:user uuid="d5ff1ce050ce4d3eb6beacb200c31c16">tempest-TestVolumeBootPattern-1146673908-project-member</nova:user>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:project uuid="4c6184f3bb14443693af3012edc107b0">tempest-TestVolumeBootPattern-1146673908</nova:project>
Nov 29 23:55:08 user nova-compute[75244]:       </nova:owner>
Nov 29 23:55:08 user nova-compute[75244]:       <nova:ports>
Nov 29 23:55:08 user nova-compute[75244]:         <nova:port uuid="9b26a426-c3e9-440d-8f1f-64613ff0bd4d">
Nov 29 23:55:08 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 23:55:08 user nova-compute[75244]:         </nova:port>
Nov 29 23:55:08 user nova-compute[75244]:       </nova:ports>
Nov 29 23:55:08 user nova-compute[75244]:     </nova:instance>
Nov 29 23:55:08 user nova-compute[75244]:   </metadata>
Nov 29 23:55:08 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:55:08 user nova-compute[75244]:     <system>
Nov 29 23:55:08 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:55:08 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:55:08 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:55:08 user nova-compute[75244]:       <entry name="serial">6f62f2e1-dbe3-4034-946f-1fee834508dd</entry>
Nov 29 23:55:08 user nova-compute[75244]:       <entry name="uuid">6f62f2e1-dbe3-4034-946f-1fee834508dd</entry>
Nov 29 23:55:08 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:55:08 user nova-compute[75244]:     </system>
Nov 29 23:55:08 user nova-compute[75244]:   </sysinfo>
Nov 29 23:55:08 user nova-compute[75244]:   <os>
Nov 29 23:55:08 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:55:08 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:55:08 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:55:08 user nova-compute[75244]:   </os>
Nov 29 23:55:08 user nova-compute[75244]:   <features>
Nov 29 23:55:08 user nova-compute[75244]:     <acpi/>
Nov 29 23:55:08 user nova-compute[75244]:     <apic/>
Nov 29 23:55:08 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:55:08 user nova-compute[75244]:   </features>
Nov 29 23:55:08 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:55:08 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:55:08 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:55:08 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:55:08 user nova-compute[75244]:   </clock>
Nov 29 23:55:08 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:55:08 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:55:08 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:55:08 user nova-compute[75244]:   </cpu>
Nov 29 23:55:08 user nova-compute[75244]:   <devices>
Nov 29 23:55:08 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:55:08 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:55:08 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:55:08 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:55:08 user nova-compute[75244]:       <serial>3c868d84-c0a2-47dd-a115-603de5a34e0f</serial>
Nov 29 23:55:08 user nova-compute[75244]:     </disk>
Nov 29 23:55:08 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:55:08 user nova-compute[75244]:       <mac address="fa:16:3e:3a:1f:0f"/>
Nov 29 23:55:08 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:55:08 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:55:08 user nova-compute[75244]:       <target dev="tap9b26a426-c3"/>
Nov 29 23:55:08 user nova-compute[75244]:     </interface>
Nov 29 23:55:08 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:55:08 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/6f62f2e1-dbe3-4034-946f-1fee834508dd/console.log" append="off"/>
Nov 29 23:55:08 user nova-compute[75244]:     </serial>
Nov 29 23:55:08 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:55:08 user nova-compute[75244]:     <video>
Nov 29 23:55:08 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:55:08 user nova-compute[75244]:     </video>
Nov 29 23:55:08 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:55:08 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:55:08 user nova-compute[75244]:     </rng>
Nov 29 23:55:08 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:55:08 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:55:08 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:55:08 user nova-compute[75244]:     </memballoon>
Nov 29 23:55:08 user nova-compute[75244]:   </devices>
Nov 29 23:55:08 user nova-compute[75244]: </domain>
Nov 29 23:55:08 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1300045044',display_name='tempest-TestVolumeBootPattern-server-1300045044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1300045044',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-ru85x26a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:55:00Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=6f62f2e1-dbe3-4034-946f-1fee834508dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG os_vif [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df7be6af-21f4-5acb-9469-5f841b1cdb69', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b26a426-c3, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b26a426-c3, col_values=(('qos', UUID('c83be47e-ccf2-4d55-9c64-68c2521c1dc9')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b26a426-c3, col_values=(('external_ids', {'iface-id': '9b26a426-c3e9-440d-8f1f-64613ff0bd4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:1f:0f', 'vm-uuid': '6f62f2e1-dbe3-4034-946f-1fee834508dd'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:08 user nova-compute[75244]: INFO os_vif [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3')
Nov 29 23:55:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:55:09 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No VIF found with MAC fa:16:3e:3a:1f:0f, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-6e36449d-f49d-44c8-a50f-789178a5de64 req-0382e14e-427f-4cf0-9f8b-46c7da7d25c1 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6e36449d-f49d-44c8-a50f-789178a5de64 req-0382e14e-427f-4cf0-9f8b-46c7da7d25c1 service nova] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6e36449d-f49d-44c8-a50f-789178a5de64 req-0382e14e-427f-4cf0-9f8b-46c7da7d25c1 service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6e36449d-f49d-44c8-a50f-789178a5de64 req-0382e14e-427f-4cf0-9f8b-46c7da7d25c1 service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG nova.compute.manager [req-6e36449d-f49d-44c8-a50f-789178a5de64 req-0382e14e-427f-4cf0-9f8b-46c7da7d25c1 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] No waiting events found dispatching network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:55:10 user nova-compute[75244]: WARNING nova.compute.manager [req-6e36449d-f49d-44c8-a50f-789178a5de64 req-0382e14e-427f-4cf0-9f8b-46c7da7d25c1 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received unexpected event network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d for instance with vm_state building and task_state spawning.
Nov 29 23:55:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:10 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:55:12 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Instance spawned successfully.
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:55:12 user nova-compute[75244]: INFO nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:55:12 user nova-compute[75244]: INFO nova.compute.manager [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Took 13.26 seconds to build instance.
Nov 29 23:55:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c5b2793f-ade0-45e9-a62e-4cd943547632 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.356s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-847d917f-26d0-4ba8-be49-163f62d403b8 req-fb8b9058-a47b-4058-8ac7-af89ba7de5bf service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-847d917f-26d0-4ba8-be49-163f62d403b8 req-fb8b9058-a47b-4058-8ac7-af89ba7de5bf service nova] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-847d917f-26d0-4ba8-be49-163f62d403b8 req-fb8b9058-a47b-4058-8ac7-af89ba7de5bf service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-847d917f-26d0-4ba8-be49-163f62d403b8 req-fb8b9058-a47b-4058-8ac7-af89ba7de5bf service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:55:12 user nova-compute[75244]: DEBUG nova.compute.manager [req-847d917f-26d0-4ba8-be49-163f62d403b8 req-fb8b9058-a47b-4058-8ac7-af89ba7de5bf service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] No waiting events found dispatching network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:55:12 user nova-compute[75244]: WARNING nova.compute.manager [req-847d917f-26d0-4ba8-be49-163f62d403b8 req-fb8b9058-a47b-4058-8ac7-af89ba7de5bf service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received unexpected event network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d for instance with vm_state active and task_state None.
Nov 29 23:55:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:55:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:55:14 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=25.004531860351562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 6f62f2e1-dbe3-4034-946f-1fee834508dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:55:14 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:55:15 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:55:15 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:55:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 6f62f2e1-dbe3-4034-946f-1fee834508dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating instance_info_cache with network_info: [{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:55:16 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:55:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:23 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:55:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:55:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:55:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:55:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:56:15 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:56:15 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:56:15 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.003864288330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:15 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 6f62f2e1-dbe3-4034-946f-1fee834508dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:56:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 6f62f2e1-dbe3-4034-946f-1fee834508dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating instance_info_cache with network_info: [{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:56:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:25 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:36 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:56:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:56:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:56:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:56:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:50 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-changed-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:56:51 user nova-compute[75244]: DEBUG nova.compute.manager [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Refreshing instance network info cache due to event network-changed-9b26a426-c3e9-440d-8f1f-64613ff0bd4d. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:56:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] Acquiring lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:56:51 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] Acquired lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:56:51 user nova-compute[75244]: DEBUG nova.network.neutron [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Refreshing network info cache for port 9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updated VIF entry in instance network info cache for port 9b26a426-c3e9-440d-8f1f-64613ff0bd4d. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.network.neutron [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating instance_info_cache with network_info: [{"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-1aa3f779-9990-4dee-a155-eb97d82e34c7 req-56a66871-6a67-49a7-8dc9-d53d7d4b4d34 service nova] Releasing lock "refresh_cache-6f62f2e1-dbe3-4034-946f-1fee834508dd" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:52 user nova-compute[75244]: INFO nova.compute.manager [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Terminating instance
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-60ff033c-40cb-49c5-8888-d2b4dafff1cb req-c3a973a1-7444-451c-b9e6-47650d58707a service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-vif-unplugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-60ff033c-40cb-49c5-8888-d2b4dafff1cb req-c3a973a1-7444-451c-b9e6-47650d58707a service nova] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-60ff033c-40cb-49c5-8888-d2b4dafff1cb req-c3a973a1-7444-451c-b9e6-47650d58707a service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-60ff033c-40cb-49c5-8888-d2b4dafff1cb req-c3a973a1-7444-451c-b9e6-47650d58707a service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-60ff033c-40cb-49c5-8888-d2b4dafff1cb req-c3a973a1-7444-451c-b9e6-47650d58707a service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] No waiting events found dispatching network-vif-unplugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.compute.manager [req-60ff033c-40cb-49c5-8888-d2b4dafff1cb req-c3a973a1-7444-451c-b9e6-47650d58707a service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-vif-unplugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 23:56:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Instance destroyed successfully.
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'resources' on Instance uuid 6f62f2e1-dbe3-4034-946f-1fee834508dd {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1300045044',display_name='tempest-TestVolumeBootPattern-server-1300045044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1300045044',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:55:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-ru85x26a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:55:12Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=6f62f2e1-dbe3-4034-946f-1fee834508dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "address": "fa:16:3e:3a:1f:0f", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b26a426-c3", "ovs_interfaceid": "9b26a426-c3e9-440d-8f1f-64613ff0bd4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_vif [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b26a426-c3, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c83be47e-ccf2-4d55-9c64-68c2521c1dc9) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:56:52 user nova-compute[75244]: INFO os_vif [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:1f:0f,bridge_name='br-int',has_traffic_filtering=True,id=9b26a426-c3e9-440d-8f1f-64613ff0bd4d,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b26a426-c3')
Nov 29 23:56:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:56:52 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3407c00-3cd1-487b-9bb6-82b47899d8e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 23:56:52 user nova-compute[75244]: No targets found.
Nov 29 23:56:52 user nova-compute[75244]: iSNS:
Nov 29 23:56:52 user nova-compute[75244]: No targets found.
Nov 29 23:56:52 user nova-compute[75244]: STATIC:
Nov 29 23:56:52 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f
Nov 29 23:56:52 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 29 23:56:52 user nova-compute[75244]:                 Iface Name: default
Nov 29 23:56:52 user nova-compute[75244]: FIRMWARE:
Nov 29 23:56:52 user nova-compute[75244]: No targets found.
Nov 29 23:56:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 23:56:52 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 23:56:52 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e33b4-b393-46c5-ad00-13630ef52f49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cdef2f-cb28-452d-8788-e065c15a7fb0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:56:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:56:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804210dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[88973627-cfeb-4859-b946-b402bd17249a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c305fcd-29c3-41aa-8740-b23ce2ab0678]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a44f9-1b04-4733-b0fd-7441fda90e6b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0d3cf-c8d9-4e38-9080-df3437bc9a5f]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23863386530613633', '/dev/disk/by-id/scsi-1SCST_BIO3ed4c37a-8c8e0a63797adef7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ed4c37a') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 23:56:53 user nova-compute[75244]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO3ed4c37a-8c8e0a63797adef7
Nov 29 23:56:53 user nova-compute[75244]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_3ed4c37a
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d824a35-7367-4aac-818e-2fb7a86df542]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f16384-6e56-4aa1-8a1b-3b589a452083]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28622f0-9d49-4db1-a5aa-6f590d7046e5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]
Nov 29 23:56:53 user nova-compute[75244]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.
Nov 29 23:56:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[74474861-6460-46e0-a827-50f53a48d42f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== disconnect_volume: return (289ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 23:56:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Deleting instance files /opt/stack/data/nova/instances/6f62f2e1-dbe3-4034-946f-1fee834508dd_del
Nov 29 23:56:53 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Deletion of /opt/stack/data/nova/instances/6f62f2e1-dbe3-4034-946f-1fee834508dd_del complete
Nov 29 23:56:53 user nova-compute[75244]: INFO nova.compute.manager [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 23:56:53 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 23:56:53 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:56:53 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Took 0.69 seconds to deallocate network for instance.
Nov 29 23:56:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-6dc3c51b-a756-4e0d-8a06-01695c8a18cf req-2080b631-91c2-4127-b70f-dba0c0356f85 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-vif-deleted-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-e5a4c0df-0bd1-4ace-9662-7a6b58ae1aa3 req-5d808c53-dfc6-4552-a5f1-ec1a8fcb5d15 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received event network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5a4c0df-0bd1-4ace-9662-7a6b58ae1aa3 req-5d808c53-dfc6-4552-a5f1-ec1a8fcb5d15 service nova] Acquiring lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5a4c0df-0bd1-4ace-9662-7a6b58ae1aa3 req-5d808c53-dfc6-4552-a5f1-ec1a8fcb5d15 service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e5a4c0df-0bd1-4ace-9662-7a6b58ae1aa3 req-5d808c53-dfc6-4552-a5f1-ec1a8fcb5d15 service nova] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG nova.compute.manager [req-e5a4c0df-0bd1-4ace-9662-7a6b58ae1aa3 req-5d808c53-dfc6-4552-a5f1-ec1a8fcb5d15 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] No waiting events found dispatching network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:56:54 user nova-compute[75244]: WARNING nova.compute.manager [req-e5a4c0df-0bd1-4ace-9662-7a6b58ae1aa3 req-5d808c53-dfc6-4552-a5f1-ec1a8fcb5d15 service nova] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Received unexpected event network-vif-plugged-9b26a426-c3e9-440d-8f1f-64613ff0bd4d for instance with vm_state active and task_state deleting.
Nov 29 23:56:54 user nova-compute[75244]: INFO nova.compute.manager [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 6f62f2e1-dbe3-4034-946f-1fee834508dd] Took 0.81 seconds to detach 1 volumes for instance.
Nov 29 23:56:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:56:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:55 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Deleted allocations for instance 6f62f2e1-dbe3-4034-946f-1fee834508dd
Nov 29 23:56:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f17e00d8-a171-49a6-8b89-5833702c0934 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "6f62f2e1-dbe3-4034-946f-1fee834508dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.917s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:56:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:56:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:57:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:57:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:57:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:57:17 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:57:17 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.00299072265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:57:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:57:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:57:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:43 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:57:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:43 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:57:43 user nova-compute[75244]: INFO nova.compute.claims [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Claim successful on node user
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:57:44 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:57:44 user nova-compute[75244]: INFO nova.virt.block_device [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Booting with volume 3c868d84-c0a2-47dd-a115-603de5a34e0f at /dev/vda
Nov 29 23:57:44 user nova-compute[75244]: DEBUG os_brick.utils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.policy [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5ff1ce050ce4d3eb6beacb200c31c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6184f3bb14443693af3012edc107b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[54641dc9-1dc7-44e3-aa5f-e3bb0f4aadf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df53906-fb3a-49d4-bdeb-078907607a74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee276430-cc7f-4087-abb2-e9a96ecb35f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0b8f2-3f50-4e43-acc6-a9e9917251ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:57:44 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:57:44 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae5ace-95e5-4d3c-abb1-93b1957bcc39]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG os_brick.utils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:57:44 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating existing volume attachment record: 9f965fdf-c0f5-4687-abf1-cbbe176aed9c {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:57:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Successfully created port: 18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:57:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Successfully updated port: 18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:57:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:57:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:57:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-changed-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Refreshing instance network info cache due to event network-changed-18b8411c-6567-4e31-b090-8abe3c8bf58b. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Instance network_info: |[{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Refreshing network info cache for port 18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated VIF entry in instance network info cache for port 18b8411c-6567-4e31-b090-8abe3c8bf58b. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:57:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-8b39d6a5-ad0e-4f09-a837-bc1acb5c35ee req-8a4d1f5f-1ff4-4873-84cb-3c8704165b01 service nova] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:57:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:57:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Creating image(s)
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Ensure instance console log exists: /opt/stack/data/nova/instances/8f244e30-e5b0-4585-89e4-bd8f7ef63e39/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Start _get_guest_xml network_info=[{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f244e30-e5b0-4585-89e4-bd8f7ef63e39', 'attached_at': '', 'detached_at': '', 'volume_id': '3c868d84-c0a2-47dd-a115-603de5a34e0f', 'serial': '3c868d84-c0a2-47dd-a115-603de5a34e0f'}, 'attachment_id': '9f965fdf-c0f5-4687-abf1-cbbe176aed9c', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:57:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:57:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:57:52 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:57:52 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:57:52 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a2d3ee-2039-4727-b064-a3cdc1c684a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:57:52 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[36198e8a-5e9a-406c-a153-61e302f9fc0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f] added
Nov 29 23:57:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b3a44d-ee06-4604-8f18-30b57a90cecb]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5ba183-c400-4876-a526-f215ca7cc461]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqZsFPvV {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqZsFPvV" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c199392-1685-4b17-92f4-a0b43c63fff3]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yqZsFPvV'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b395d6a3-ead4-41f3-bbba-b9d551f66be1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[904fad28-b496-4084-a1c8-252b1bd2e454]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:57:52 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 23:57:52 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:57:52 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 23:57:52 user nova-compute[75244]: 
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c62729-5a43-40b9-a2d8-e1f1400445fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]
Nov 29 23:57:52 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.
Nov 29 23:57:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe586175-cd01-4c71-bace-e5ded853a793]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b65ba-d5ab-440e-95c6-4975724f3ed8]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:57:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:57:52 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6abcf3-1b4d-4735-b09d-0cf80fda1b87]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:57:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23863386530613633', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863386530613633', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-618619102',display_name='tempest-TestVolumeBootPattern-server-618619102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-618619102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-90ni11ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:57:44Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=8f244e30-e5b0-4585-89e4-bd8f7ef63e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:57:53 user nova-compute[75244]:   <uuid>8f244e30-e5b0-4585-89e4-bd8f7ef63e39</uuid>
Nov 29 23:57:53 user nova-compute[75244]:   <name>instance-00000033</name>
Nov 29 23:57:53 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:57:53 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:57:53 user nova-compute[75244]:   <metadata>
Nov 29 23:57:53 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:57:53 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:57:53 user nova-compute[75244]:       <nova:name>tempest-TestVolumeBootPattern-server-618619102</nova:name>
Nov 29 23:57:53 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:57:52</nova:creationTime>
Nov 29 23:57:53 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:57:53 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:57:53 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:57:53 user nova-compute[75244]:       <nova:owner>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:user uuid="d5ff1ce050ce4d3eb6beacb200c31c16">tempest-TestVolumeBootPattern-1146673908-project-member</nova:user>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:project uuid="4c6184f3bb14443693af3012edc107b0">tempest-TestVolumeBootPattern-1146673908</nova:project>
Nov 29 23:57:53 user nova-compute[75244]:       </nova:owner>
Nov 29 23:57:53 user nova-compute[75244]:       <nova:ports>
Nov 29 23:57:53 user nova-compute[75244]:         <nova:port uuid="18b8411c-6567-4e31-b090-8abe3c8bf58b">
Nov 29 23:57:53 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 23:57:53 user nova-compute[75244]:         </nova:port>
Nov 29 23:57:53 user nova-compute[75244]:       </nova:ports>
Nov 29 23:57:53 user nova-compute[75244]:     </nova:instance>
Nov 29 23:57:53 user nova-compute[75244]:   </metadata>
Nov 29 23:57:53 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:57:53 user nova-compute[75244]:     <system>
Nov 29 23:57:53 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:57:53 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:57:53 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:57:53 user nova-compute[75244]:       <entry name="serial">8f244e30-e5b0-4585-89e4-bd8f7ef63e39</entry>
Nov 29 23:57:53 user nova-compute[75244]:       <entry name="uuid">8f244e30-e5b0-4585-89e4-bd8f7ef63e39</entry>
Nov 29 23:57:53 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:57:53 user nova-compute[75244]:     </system>
Nov 29 23:57:53 user nova-compute[75244]:   </sysinfo>
Nov 29 23:57:53 user nova-compute[75244]:   <os>
Nov 29 23:57:53 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:57:53 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:57:53 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:57:53 user nova-compute[75244]:   </os>
Nov 29 23:57:53 user nova-compute[75244]:   <features>
Nov 29 23:57:53 user nova-compute[75244]:     <acpi/>
Nov 29 23:57:53 user nova-compute[75244]:     <apic/>
Nov 29 23:57:53 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:57:53 user nova-compute[75244]:   </features>
Nov 29 23:57:53 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:57:53 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:57:53 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:57:53 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:57:53 user nova-compute[75244]:   </clock>
Nov 29 23:57:53 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:57:53 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:57:53 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:57:53 user nova-compute[75244]:   </cpu>
Nov 29 23:57:53 user nova-compute[75244]:   <devices>
Nov 29 23:57:53 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:57:53 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:57:53 user nova-compute[75244]:       <source dev="/dev/sdb"/>
Nov 29 23:57:53 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:57:53 user nova-compute[75244]:       <serial>3c868d84-c0a2-47dd-a115-603de5a34e0f</serial>
Nov 29 23:57:53 user nova-compute[75244]:     </disk>
Nov 29 23:57:53 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:57:53 user nova-compute[75244]:       <mac address="fa:16:3e:a2:70:34"/>
Nov 29 23:57:53 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:57:53 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:57:53 user nova-compute[75244]:       <target dev="tap18b8411c-65"/>
Nov 29 23:57:53 user nova-compute[75244]:     </interface>
Nov 29 23:57:53 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:57:53 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/8f244e30-e5b0-4585-89e4-bd8f7ef63e39/console.log" append="off"/>
Nov 29 23:57:53 user nova-compute[75244]:     </serial>
Nov 29 23:57:53 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:57:53 user nova-compute[75244]:     <video>
Nov 29 23:57:53 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:57:53 user nova-compute[75244]:     </video>
Nov 29 23:57:53 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:57:53 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:57:53 user nova-compute[75244]:     </rng>
Nov 29 23:57:53 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:57:53 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:57:53 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:57:53 user nova-compute[75244]:     </memballoon>
Nov 29 23:57:53 user nova-compute[75244]:   </devices>
Nov 29 23:57:53 user nova-compute[75244]: </domain>
Nov 29 23:57:53 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-618619102',display_name='tempest-TestVolumeBootPattern-server-618619102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-618619102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-90ni11ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:57:44Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=8f244e30-e5b0-4585-89e4-bd8f7ef63e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG os_vif [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59e32e41-302b-5954-99bb-737e1f51b1e1', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18b8411c-65, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18b8411c-65, col_values=(('qos', UUID('15422642-622c-43aa-8429-04a78429be7f')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18b8411c-65, col_values=(('external_ids', {'iface-id': '18b8411c-6567-4e31-b090-8abe3c8bf58b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:70:34', 'vm-uuid': '8f244e30-e5b0-4585-89e4-bd8f7ef63e39'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:53 user nova-compute[75244]: INFO os_vif [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65')
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:57:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No VIF found with MAC fa:16:3e:a2:70:34, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:57:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-70569402-5959-40dc-b891-e7506497bd19 req-7996307c-844c-4741-9ac1-ca90cf13357f service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-70569402-5959-40dc-b891-e7506497bd19 req-7996307c-844c-4741-9ac1-ca90cf13357f service nova] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-70569402-5959-40dc-b891-e7506497bd19 req-7996307c-844c-4741-9ac1-ca90cf13357f service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-70569402-5959-40dc-b891-e7506497bd19 req-7996307c-844c-4741-9ac1-ca90cf13357f service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG nova.compute.manager [req-70569402-5959-40dc-b891-e7506497bd19 req-7996307c-844c-4741-9ac1-ca90cf13357f service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] No waiting events found dispatching network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:57:55 user nova-compute[75244]: WARNING nova.compute.manager [req-70569402-5959-40dc-b891-e7506497bd19 req-7996307c-844c-4741-9ac1-ca90cf13357f service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received unexpected event network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b for instance with vm_state building and task_state spawning.
Nov 29 23:57:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:57:56 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Instance spawned successfully.
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:57:56 user nova-compute[75244]: INFO nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Took 4.82 seconds to spawn the instance on the hypervisor.
Nov 29 23:57:56 user nova-compute[75244]: DEBUG nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:57:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-f482071d-4bc5-4a50-8712-c59da8ed6305 req-d77b15a3-0fe8-447f-b4c5-7236f4da642f service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:57:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f482071d-4bc5-4a50-8712-c59da8ed6305 req-d77b15a3-0fe8-447f-b4c5-7236f4da642f service nova] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:57:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f482071d-4bc5-4a50-8712-c59da8ed6305 req-d77b15a3-0fe8-447f-b4c5-7236f4da642f service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:57:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-f482071d-4bc5-4a50-8712-c59da8ed6305 req-d77b15a3-0fe8-447f-b4c5-7236f4da642f service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:57 user nova-compute[75244]: DEBUG nova.compute.manager [req-f482071d-4bc5-4a50-8712-c59da8ed6305 req-d77b15a3-0fe8-447f-b4c5-7236f4da642f service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] No waiting events found dispatching network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:57:57 user nova-compute[75244]: WARNING nova.compute.manager [req-f482071d-4bc5-4a50-8712-c59da8ed6305 req-d77b15a3-0fe8-447f-b4c5-7236f4da642f service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received unexpected event network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b for instance with vm_state building and task_state spawning.
Nov 29 23:57:57 user nova-compute[75244]: INFO nova.compute.manager [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Took 13.21 seconds to build instance.
Nov 29 23:57:57 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2d4248f0-b00e-453a-9525-f1e4ed7e05d2 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.300s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:57:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:58:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:58:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:58:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:58:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:58:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:58:17 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:58:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:58:19 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:58:19 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.001346588134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:58:19 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:58:20 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:58:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:58:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:28 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 23:58:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:58:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:58:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:58:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:58:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:58:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:58:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:58:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:58:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:58:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 23:58:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 23:58:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:58:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:00 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 23:59:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:59:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 23:59:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 23:59:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:59:21 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=25.000743865966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 23:59:21 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 23:59:22 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 23:59:22 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 23:59:22 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:59:22 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:59:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 23:59:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-changed-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:59:35 user nova-compute[75244]: DEBUG nova.compute.manager [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Refreshing instance network info cache due to event network-changed-18b8411c-6567-4e31-b090-8abe3c8bf58b. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:59:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:59:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:59:35 user nova-compute[75244]: DEBUG nova.network.neutron [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Refreshing network info cache for port 18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:59:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated VIF entry in instance network info cache for port 18b8411c-6567-4e31-b090-8abe3c8bf58b. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:59:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:59:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-6b8bb87e-1eff-45ec-aa5d-2a20165c667f req-c1cca290-9f86-4d54-b22c-d9728248e80d service nova] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:59:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 23:59:39 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 23:59:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 23:59:44 user nova-compute[75244]: INFO nova.compute.claims [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Claim successful on node user
Nov 29 23:59:44 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 23:59:44 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 23:59:45 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.policy [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5ff1ce050ce4d3eb6beacb200c31c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6184f3bb14443693af3012edc107b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 23:59:45 user nova-compute[75244]: INFO nova.virt.block_device [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Booting with volume 56ef0a51-36ae-4641-a742-9dde8885e8cf at /dev/vda
Nov 29 23:59:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babcdf6-8d1f-445c-b7e3-7b4fc05a387d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[740da033-d1af-4206-adfe-8aaf14289590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[209a02d3-15ef-48dd-9a76-b8b465166539]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5adbe28-a69c-487a-bd14-9d3cbb03b4ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 23:59:45 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 23:59:45 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd1e226-3118-4a46-b035-95d8c6637a4c]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG os_brick.utils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating existing volume attachment record: 54e86b6c-c980-4f15-9aa3-7dfd873c1310 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 23:59:45 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Successfully created port: aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Successfully updated port: aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquired lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-changed-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.compute.manager [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Refreshing instance network info cache due to event network-changed-aa331e7c-a5cf-41d5-b2fc-166728732958. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] Acquiring lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.network.neutron [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating instance_info_cache with network_info: [{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Releasing lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Instance network_info: |[{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] Acquired lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 23:59:46 user nova-compute[75244]: DEBUG nova.network.neutron [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Refreshing network info cache for port aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 23:59:47 user nova-compute[75244]: DEBUG nova.network.neutron [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updated VIF entry in instance network info cache for port aa331e7c-a5cf-41d5-b2fc-166728732958. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 23:59:47 user nova-compute[75244]: DEBUG nova.network.neutron [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating instance_info_cache with network_info: [{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 23:59:47 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-16da5347-f0ab-402b-92a9-96cfd8552063 req-b5443aaf-26f4-4e64-8e39-a371b10ae525 service nova] Releasing lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 23:59:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 23:59:52 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Creating image(s)
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Did not create local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Ensure instance console log exists: /opt/stack/data/nova/instances/62a3a533-01bf-4178-8bef-fd42387ebbb5/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Start _get_guest_xml network_info=[{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNGHfeOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62a3a533-01bf-4178-8bef-fd42387ebbb5', 'attached_at': '', 'detached_at': '', 'volume_id': '56ef0a51-36ae-4641-a742-9dde8885e8cf', 'serial': '56ef0a51-36ae-4641-a742-9dde8885e8cf'}, 'attachment_id': '54e86b6c-c980-4f15-9aa3-7dfd873c1310', 'volume_type': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 23:59:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:59:52 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 23:59:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNGHfeOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 23:59:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:59:53 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 23:59:53 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033709f-f97e-436b-a28c-9c4c6b8e1f4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 23:59:53 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dae127-051e-47f7-bce8-b1d66c784043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf] added
Nov 29 23:59:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1adc1b-fd56-481d-9393-87543a50b26f]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[494412f5-bb13-4ae2-8240-d8b8e71d0153]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNGHfeOA {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNGHfeOA" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f7f63-2a65-41fa-af47-06ff3432b1a1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jNGHfeOA'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d90c1-4517-4a10-8dca-193297cb7aea]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b0416a-dcc8-4afa-a83d-9a75ab2e012f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:59:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:59:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca6587-3f83-47ea-9978-fbe6e07d401c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260]
Nov 29 23:59:53 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260] successful.
Nov 29 23:59:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.143s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e568c9-d310-40c4-b871-f2d7895d305e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0dc244-0a29-4593-9af1-15794bc9d141]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:59:53 user nova-compute[75244]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf (non-flash)
Nov 29 23:59:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 29 23:59:53 user nova-compute[75244]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf (non-flash)
Nov 29 23:59:53 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5416cb-0574-4ba5-a28e-46fbbadff970]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNGHfeOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 23:59:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23737613936373937', 'path': '/dev/sdc'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737613936373937', 'path': '/dev/sdc'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-729048045',display_name='tempest-TestVolumeBootPattern-server-729048045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-729048045',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-x1blj7dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:59:45Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=62a3a533-01bf-4178-8bef-fd42387ebbb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.objects.instance [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'pci_devices' on Instance uuid 62a3a533-01bf-4178-8bef-fd42387ebbb5 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 23:59:54 user nova-compute[75244]:   <uuid>62a3a533-01bf-4178-8bef-fd42387ebbb5</uuid>
Nov 29 23:59:54 user nova-compute[75244]:   <name>instance-00000034</name>
Nov 29 23:59:54 user nova-compute[75244]:   <memory>524288</memory>
Nov 29 23:59:54 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 29 23:59:54 user nova-compute[75244]:   <metadata>
Nov 29 23:59:54 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 23:59:54 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 29 23:59:54 user nova-compute[75244]:       <nova:name>tempest-TestVolumeBootPattern-server-729048045</nova:name>
Nov 29 23:59:54 user nova-compute[75244]:       <nova:creationTime>2023-11-29 23:59:52</nova:creationTime>
Nov 29 23:59:54 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 29 23:59:54 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 29 23:59:54 user nova-compute[75244]:       </nova:flavor>
Nov 29 23:59:54 user nova-compute[75244]:       <nova:owner>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:user uuid="d5ff1ce050ce4d3eb6beacb200c31c16">tempest-TestVolumeBootPattern-1146673908-project-member</nova:user>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:project uuid="4c6184f3bb14443693af3012edc107b0">tempest-TestVolumeBootPattern-1146673908</nova:project>
Nov 29 23:59:54 user nova-compute[75244]:       </nova:owner>
Nov 29 23:59:54 user nova-compute[75244]:       <nova:ports>
Nov 29 23:59:54 user nova-compute[75244]:         <nova:port uuid="aa331e7c-a5cf-41d5-b2fc-166728732958">
Nov 29 23:59:54 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 23:59:54 user nova-compute[75244]:         </nova:port>
Nov 29 23:59:54 user nova-compute[75244]:       </nova:ports>
Nov 29 23:59:54 user nova-compute[75244]:     </nova:instance>
Nov 29 23:59:54 user nova-compute[75244]:   </metadata>
Nov 29 23:59:54 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 29 23:59:54 user nova-compute[75244]:     <system>
Nov 29 23:59:54 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 23:59:54 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 29 23:59:54 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 29 23:59:54 user nova-compute[75244]:       <entry name="serial">62a3a533-01bf-4178-8bef-fd42387ebbb5</entry>
Nov 29 23:59:54 user nova-compute[75244]:       <entry name="uuid">62a3a533-01bf-4178-8bef-fd42387ebbb5</entry>
Nov 29 23:59:54 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 29 23:59:54 user nova-compute[75244]:     </system>
Nov 29 23:59:54 user nova-compute[75244]:   </sysinfo>
Nov 29 23:59:54 user nova-compute[75244]:   <os>
Nov 29 23:59:54 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 23:59:54 user nova-compute[75244]:     <boot dev="hd"/>
Nov 29 23:59:54 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 29 23:59:54 user nova-compute[75244]:   </os>
Nov 29 23:59:54 user nova-compute[75244]:   <features>
Nov 29 23:59:54 user nova-compute[75244]:     <acpi/>
Nov 29 23:59:54 user nova-compute[75244]:     <apic/>
Nov 29 23:59:54 user nova-compute[75244]:     <vmcoreinfo/>
Nov 29 23:59:54 user nova-compute[75244]:   </features>
Nov 29 23:59:54 user nova-compute[75244]:   <clock offset="utc">
Nov 29 23:59:54 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 23:59:54 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 23:59:54 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 29 23:59:54 user nova-compute[75244]:   </clock>
Nov 29 23:59:54 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 29 23:59:54 user nova-compute[75244]:     <model>Nehalem</model>
Nov 29 23:59:54 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 23:59:54 user nova-compute[75244]:   </cpu>
Nov 29 23:59:54 user nova-compute[75244]:   <devices>
Nov 29 23:59:54 user nova-compute[75244]:     <disk type="block" device="disk">
Nov 29 23:59:54 user nova-compute[75244]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 23:59:54 user nova-compute[75244]:       <source dev="/dev/sdc"/>
Nov 29 23:59:54 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 29 23:59:54 user nova-compute[75244]:       <serial>56ef0a51-36ae-4641-a742-9dde8885e8cf</serial>
Nov 29 23:59:54 user nova-compute[75244]:     </disk>
Nov 29 23:59:54 user nova-compute[75244]:     <interface type="ethernet">
Nov 29 23:59:54 user nova-compute[75244]:       <mac address="fa:16:3e:65:4c:ad"/>
Nov 29 23:59:54 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:59:54 user nova-compute[75244]:       <mtu size="1442"/>
Nov 29 23:59:54 user nova-compute[75244]:       <target dev="tapaa331e7c-a5"/>
Nov 29 23:59:54 user nova-compute[75244]:     </interface>
Nov 29 23:59:54 user nova-compute[75244]:     <serial type="pty">
Nov 29 23:59:54 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/62a3a533-01bf-4178-8bef-fd42387ebbb5/console.log" append="off"/>
Nov 29 23:59:54 user nova-compute[75244]:     </serial>
Nov 29 23:59:54 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 23:59:54 user nova-compute[75244]:     <video>
Nov 29 23:59:54 user nova-compute[75244]:       <model type="virtio"/>
Nov 29 23:59:54 user nova-compute[75244]:     </video>
Nov 29 23:59:54 user nova-compute[75244]:     <rng model="virtio">
Nov 29 23:59:54 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 29 23:59:54 user nova-compute[75244]:     </rng>
Nov 29 23:59:54 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 29 23:59:54 user nova-compute[75244]:     <memballoon model="virtio">
Nov 29 23:59:54 user nova-compute[75244]:       <stats period="10"/>
Nov 29 23:59:54 user nova-compute[75244]:     </memballoon>
Nov 29 23:59:54 user nova-compute[75244]:   </devices>
Nov 29 23:59:54 user nova-compute[75244]: </domain>
Nov 29 23:59:54 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-729048045',display_name='tempest-TestVolumeBootPattern-server-729048045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-729048045',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-x1blj7dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T23:59:45Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=62a3a533-01bf-4178-8bef-fd42387ebbb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG os_vif [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdfba962-c05d-5fa2-9b17-67b991e98b87', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa331e7c-a5, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa331e7c-a5, col_values=(('qos', UUID('378711ee-cd2e-4c45-b60c-843353bebb23')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa331e7c-a5, col_values=(('external_ids', {'iface-id': 'aa331e7c-a5cf-41d5-b2fc-166728732958', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:4c:ad', 'vm-uuid': '62a3a533-01bf-4178-8bef-fd42387ebbb5'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:54 user nova-compute[75244]: INFO os_vif [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5')
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 23:59:54 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] No VIF found with MAC fa:16:3e:65:4c:ad, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 23:59:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:55 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-c8c69f3f-9d4d-4552-a873-3914cdc16e7c req-bfd1e6e9-57cc-419e-8a97-906d13007067 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c8c69f3f-9d4d-4552-a873-3914cdc16e7c req-bfd1e6e9-57cc-419e-8a97-906d13007067 service nova] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c8c69f3f-9d4d-4552-a873-3914cdc16e7c req-bfd1e6e9-57cc-419e-8a97-906d13007067 service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-c8c69f3f-9d4d-4552-a873-3914cdc16e7c req-bfd1e6e9-57cc-419e-8a97-906d13007067 service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:56 user nova-compute[75244]: DEBUG nova.compute.manager [req-c8c69f3f-9d4d-4552-a873-3914cdc16e7c req-bfd1e6e9-57cc-419e-8a97-906d13007067 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] No waiting events found dispatching network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:59:56 user nova-compute[75244]: WARNING nova.compute.manager [req-c8c69f3f-9d4d-4552-a873-3914cdc16e7c req-bfd1e6e9-57cc-419e-8a97-906d13007067 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received unexpected event network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 for instance with vm_state building and task_state spawning.
Nov 29 23:59:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 23:59:57 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Instance spawned successfully.
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 23:59:57 user nova-compute[75244]: INFO nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 29 23:59:57 user nova-compute[75244]: DEBUG nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 23:59:58 user nova-compute[75244]: INFO nova.compute.manager [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Took 13.28 seconds to build instance.
Nov 29 23:59:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-6f4e4841-b145-4873-9405-d6cafd74dd14 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.371s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c5e9169-b3ef-47ab-a202-ad8ebf85913e req-3c3349b4-fb09-40f4-ade2-870f66af86de service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 23:59:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c5e9169-b3ef-47ab-a202-ad8ebf85913e req-3c3349b4-fb09-40f4-ade2-870f66af86de service nova] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 23:59:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c5e9169-b3ef-47ab-a202-ad8ebf85913e req-3c3349b4-fb09-40f4-ade2-870f66af86de service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 23:59:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-9c5e9169-b3ef-47ab-a202-ad8ebf85913e req-3c3349b4-fb09-40f4-ade2-870f66af86de service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 23:59:58 user nova-compute[75244]: DEBUG nova.compute.manager [req-9c5e9169-b3ef-47ab-a202-ad8ebf85913e req-3c3349b4-fb09-40f4-ade2-870f66af86de service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] No waiting events found dispatching network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 23:59:58 user nova-compute[75244]: WARNING nova.compute.manager [req-9c5e9169-b3ef-47ab-a202-ad8ebf85913e req-3c3349b4-fb09-40f4-ade2-870f66af86de service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received unexpected event network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 for instance with vm_state active and task_state None.
Nov 29 23:59:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:00:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:06 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:00:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:00:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 00:00:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:00:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.99819564819336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 62a3a533-01bf-4178-8bef-fd42387ebbb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:00:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:00:23 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:00:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:00:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:00:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:00:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:00:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:41 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:00:44 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:00:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:00:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:49 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:00:54 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:00:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:00:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:00:59 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:04 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:09 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:14 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating instance_info_cache with network_info: [{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:01:19 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:01:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 00:01:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:01:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:01:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=24.997570037841797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 62a3a533-01bf-4178-8bef-fd42387ebbb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:01:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:24 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:01:34 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-changed-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG nova.compute.manager [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Refreshing instance network info cache due to event network-changed-aa331e7c-a5cf-41d5-b2fc-166728732958. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] Acquiring lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] Acquired lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Refreshing network info cache for port aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updated VIF entry in instance network info cache for port aa331e7c-a5cf-41d5-b2fc-166728732958. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG nova.network.neutron [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating instance_info_cache with network_info: [{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:01:36 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-a0e5c8fb-f946-42da-a68b-cf8bfafd156e req-f180ac61-cc81-40a0-a7b0-b38dfdea44ae service nova] Releasing lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:37 user nova-compute[75244]: INFO nova.compute.manager [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Terminating instance
Nov 30 00:01:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Instance destroyed successfully.
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.objects.instance [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'resources' on Instance uuid 62a3a533-01bf-4178-8bef-fd42387ebbb5 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-729048045',display_name='tempest-TestVolumeBootPattern-server-729048045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-729048045',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-x1blj7dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:59:58Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=62a3a533-01bf-4178-8bef-fd42387ebbb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_vif [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa331e7c-a5, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=378711ee-cd2e-4c45-b60c-843353bebb23) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:38 user nova-compute[75244]: INFO os_vif [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=aa331e7c-a5cf-41d5-b2fc-166728732958,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa331e7c-a5')
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNGHfeOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:01:38 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd64de8-b783-4ce1-99df-93a2a7710026]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 00:01:38 user nova-compute[75244]: No targets found.
Nov 30 00:01:38 user nova-compute[75244]: iSNS:
Nov 30 00:01:38 user nova-compute[75244]: No targets found.
Nov 30 00:01:38 user nova-compute[75244]: STATIC:
Nov 30 00:01:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f
Nov 30 00:01:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:01:38 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:01:38 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf
Nov 30 00:01:38 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:01:38 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:01:38 user nova-compute[75244]: FIRMWARE:
Nov 30 00:01:38 user nova-compute[75244]: No targets found.
Nov 30 00:01:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 00:01:38 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 00:01:38 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a75689-538a-40e9-b668-2d3db84d5786]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe1ae0f-4752-4abe-99cd-2ee318518f4c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 30 00:01:38 user nova-compute[75244]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf (non-flash)
Nov 30 00:01:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 30 00:01:38 user nova-compute[75244]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf (non-flash)
Nov 30 00:01:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c1a9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf'): ({'sdc'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Removing single pathed devices sdc {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a528b3-66d6-4cb7-b999-60e8d4c4c790]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70d173-6c96-45d9-a619-177af84d2d07]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flushing IO for device /dev/sdc {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-changed-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Refreshing instance network info cache due to event network-changed-aa331e7c-a5cf-41d5-b2fc-166728732958. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Acquiring lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Acquired lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Refreshing network info cache for port aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f53eb-c364-440d-931b-d8a514f2deae]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba0557-e2c0-4639-b103-3c07a16d56f9]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] SCSI volumes sdc have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_efc0791e', '/dev/disk/by-id/scsi-1SCST_BIOefc0791e-77a967975b0af93a', '/dev/disk/by-id/scsi-23737613936373937') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cb8363-dead-4926-a00a-530c3c614f0c]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb4e0a0-1755-4d0d-978a-9c7078791042]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[1196fbbb-8eb7-4e21-b355-5affe90936e1]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260]
Nov 30 00:01:38 user nova-compute[75244]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf, portal: 172.16.0.220,3260] successful.
Nov 30 00:01:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56ef0a51-36ae-4641-a742-9dde8885e8cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d64c1a-ae7e-4855-9583-a7f9fb775c11]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== disconnect_volume: return (322ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 00:01:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Deleting instance files /opt/stack/data/nova/instances/62a3a533-01bf-4178-8bef-fd42387ebbb5_del
Nov 30 00:01:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Deletion of /opt/stack/data/nova/instances/62a3a533-01bf-4178-8bef-fd42387ebbb5_del complete
Nov 30 00:01:38 user nova-compute[75244]: INFO nova.compute.manager [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updated VIF entry in instance network info cache for port aa331e7c-a5cf-41d5-b2fc-166728732958. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.network.neutron [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating instance_info_cache with network_info: [{"id": "aa331e7c-a5cf-41d5-b2fc-166728732958", "address": "fa:16:3e:65:4c:ad", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa331e7c-a5", "ovs_interfaceid": "aa331e7c-a5cf-41d5-b2fc-166728732958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Releasing lock "refresh_cache-62a3a533-01bf-4178-8bef-fd42387ebbb5" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-vif-unplugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] No waiting events found dispatching network-vif-unplugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-vif-unplugged-aa331e7c-a5cf-41d5-b2fc-166728732958 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Acquiring lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] No waiting events found dispatching network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:01:38 user nova-compute[75244]: WARNING nova.compute.manager [req-e3bea7a9-e38a-45f7-835e-176d3d6ad26e req-b7ffff5c-3e9d-479c-be0d-53920c8c86f5 service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received unexpected event network-vif-plugged-aa331e7c-a5cf-41d5-b2fc-166728732958 for instance with vm_state active and task_state deleting.
Nov 30 00:01:39 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:01:39 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Took 0.59 seconds to deallocate network for instance.
Nov 30 00:01:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-0fe58630-c452-4a65-bdf3-593152fc0513 req-e2946476-cefe-4121-8b8b-ad17f02decbc service nova] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Received event network-vif-deleted-aa331e7c-a5cf-41d5-b2fc-166728732958 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:01:40 user nova-compute[75244]: INFO nova.compute.manager [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 62a3a533-01bf-4178-8bef-fd42387ebbb5] Took 0.88 seconds to detach 1 volumes for instance.
Nov 30 00:01:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:01:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:01:40 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:01:40 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:01:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:40 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Deleted allocations for instance 62a3a533-01bf-4178-8bef-fd42387ebbb5
Nov 30 00:01:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-45c176e8-a712-453a-8101-6e5d911408e9 tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "62a3a533-01bf-4178-8bef-fd42387ebbb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.983s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:01:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:01:42 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:01:43 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:48 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:01:53 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:01:58 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:03 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:02:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:13 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:02:20 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:02:21 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:02:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:02:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:02:21 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75244) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 00:02:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:02:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:02:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.996700286865234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:02:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:02:23 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:02:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:02:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:02:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:02:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:33 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:02:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-changed-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Refreshing instance network info cache due to event network-changed-18b8411c-6567-4e31-b090-8abe3c8bf58b. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] Acquiring lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] Acquired lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Refreshing network info cache for port 18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:37 user nova-compute[75244]: INFO nova.compute.manager [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Terminating instance
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updated VIF entry in instance network info cache for port 18b8411c-6567-4e31-b090-8abe3c8bf58b. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.network.neutron [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [{"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b48609e2-4c13-4b3a-b9a4-a04c5758dadc req-f1465d18-43db-409c-aebf-e161383b1cb5 service nova] Releasing lock "refresh_cache-8f244e30-e5b0-4585-89e4-bd8f7ef63e39" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-994bad84-d379-4183-9340-c35e00484147 req-482188a1-a0cc-403a-9c9d-987fbae97db0 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-vif-unplugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-994bad84-d379-4183-9340-c35e00484147 req-482188a1-a0cc-403a-9c9d-987fbae97db0 service nova] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-994bad84-d379-4183-9340-c35e00484147 req-482188a1-a0cc-403a-9c9d-987fbae97db0 service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-994bad84-d379-4183-9340-c35e00484147 req-482188a1-a0cc-403a-9c9d-987fbae97db0 service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-994bad84-d379-4183-9340-c35e00484147 req-482188a1-a0cc-403a-9c9d-987fbae97db0 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] No waiting events found dispatching network-vif-unplugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.compute.manager [req-994bad84-d379-4183-9340-c35e00484147 req-482188a1-a0cc-403a-9c9d-987fbae97db0 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-vif-unplugged-18b8411c-6567-4e31-b090-8abe3c8bf58b for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 00:02:37 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Instance destroyed successfully.
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.objects.instance [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lazy-loading 'resources' on Instance uuid 8f244e30-e5b0-4585-89e4-bd8f7ef63e39 {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T23:57:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-618619102',display_name='tempest-TestVolumeBootPattern-server-618619102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-618619102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqiu9eps62cLVqcgi+0Hs4GXtwcfhKNt0LrlE50mje5eBhak83Vryo1l0M+g0zcwVp1/glnWtkcJ4LlecqOjeV2FZxjVf7haD1qobPnf8wt3ohPSex5FjEy0HQtmiG3vg==',key_name='tempest-TestVolumeBootPattern-897107719',keypairs=<?>,launch_index=0,launched_at=2023-11-29T23:57:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6184f3bb14443693af3012edc107b0',ramdisk_id='',reservation_id='r-90ni11ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1146673908',owner_user_name='tempest-TestVolumeBootPattern-1146673908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T23:57:57Z,user_data=None,user_id='d5ff1ce050ce4d3eb6beacb200c31c16',uuid=8f244e30-e5b0-4585-89e4-bd8f7ef63e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converting VIF {"id": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "address": "fa:16:3e:a2:70:34", "network": {"id": "3fd44c3f-68a3-41a5-986b-f031229c4e42", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1754210742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6184f3bb14443693af3012edc107b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b8411c-65", "ovs_interfaceid": "18b8411c-6567-4e31-b090-8abe3c8bf58b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_vif [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18b8411c-65, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15422642-622c-43aa-8429-04a78429be7f) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:37 user nova-compute[75244]: INFO os_vif [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:70:34,bridge_name='br-int',has_traffic_filtering=True,id=18b8411c-6567-4e31-b090-8abe3c8bf58b,network=Network(3fd44c3f-68a3-41a5-986b-f031229c4e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b8411c-65')
Nov 30 00:02:37 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqZsFPvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:02:37 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd329dd-72db-4a59-a24e-9b418b857150]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 00:02:37 user nova-compute[75244]: No targets found.
Nov 30 00:02:37 user nova-compute[75244]: iSNS:
Nov 30 00:02:37 user nova-compute[75244]: No targets found.
Nov 30 00:02:37 user nova-compute[75244]: STATIC:
Nov 30 00:02:37 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f
Nov 30 00:02:37 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:02:37 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:02:37 user nova-compute[75244]: FIRMWARE:
Nov 30 00:02:37 user nova-compute[75244]: No targets found.
Nov 30 00:02:37 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 00:02:37 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 00:02:37 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 00:02:37 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153aded-5daa-49e7-adf8-f15e92824a1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7fe93e-9889-4ff9-98f1-1a40e2f9e272]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 30 00:02:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f (non-flash)
Nov 30 00:02:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7e078b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8adfdb3-863b-413c-afd1-61910afdf5a0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9187a205-9687-4610-af7b-96c2b5f080dc]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327b353-5fbb-4d44-9de4-33fccaefce25]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a445f23-c741-4917-8b04-bfb206666f00]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23863386530613633', '/dev/disk/by-id/scsi-1SCST_BIO3ed4c37a-8c8e0a63797adef7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ed4c37a') {{(pid=86356) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[abae7357-e3dc-43e8-9e52-08feff8eb875]: (4, None) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48633d1-543e-4358-82a2-a6c165187578]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d89b78a-3558-45af-af2a-a15464d0c38f]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260]
Nov 30 00:02:38 user nova-compute[75244]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f, portal: 172.16.0.220,3260] successful.
Nov 30 00:02:38 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c868d84-c0a2-47dd-a115-603de5a34e0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b04c8c-4d0b-4943-be84-d8100316a1a1]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] <== disconnect_volume: return (307ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 00:02:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Deleting instance files /opt/stack/data/nova/instances/8f244e30-e5b0-4585-89e4-bd8f7ef63e39_del
Nov 30 00:02:38 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Deletion of /opt/stack/data/nova/instances/8f244e30-e5b0-4585-89e4-bd8f7ef63e39_del complete
Nov 30 00:02:38 user nova-compute[75244]: INFO nova.compute.manager [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 30 00:02:38 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 00:02:38 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:02:38 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Took 0.53 seconds to deallocate network for instance.
Nov 30 00:02:38 user nova-compute[75244]: DEBUG nova.compute.manager [req-836fac38-8e20-481a-b627-8935259ae18b req-edbbd238-c8b1-48fb-a5e1-de933f3f92d6 service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-vif-deleted-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:02:39 user nova-compute[75244]: INFO nova.compute.manager [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Took 0.82 seconds to detach 1 volumes for instance.
Nov 30 00:02:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-41ef0dd2-3640-43d6-9bc4-bf9a5c7a6a8f req-2882dbbb-dc34-4070-ab4a-5835a1c1c8fa service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received event network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-41ef0dd2-3640-43d6-9bc4-bf9a5c7a6a8f req-2882dbbb-dc34-4070-ab4a-5835a1c1c8fa service nova] Acquiring lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-41ef0dd2-3640-43d6-9bc4-bf9a5c7a6a8f req-2882dbbb-dc34-4070-ab4a-5835a1c1c8fa service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-41ef0dd2-3640-43d6-9bc4-bf9a5c7a6a8f req-2882dbbb-dc34-4070-ab4a-5835a1c1c8fa service nova] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG nova.compute.manager [req-41ef0dd2-3640-43d6-9bc4-bf9a5c7a6a8f req-2882dbbb-dc34-4070-ab4a-5835a1c1c8fa service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] No waiting events found dispatching network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:02:39 user nova-compute[75244]: WARNING nova.compute.manager [req-41ef0dd2-3640-43d6-9bc4-bf9a5c7a6a8f req-2882dbbb-dc34-4070-ab4a-5835a1c1c8fa service nova] [instance: 8f244e30-e5b0-4585-89e4-bd8f7ef63e39] Received unexpected event network-vif-plugged-18b8411c-6567-4e31-b090-8abe3c8bf58b for instance with vm_state active and task_state deleting.
Nov 30 00:02:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:02:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:39 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Deleted allocations for instance 8f244e30-e5b0-4585-89e4-bd8f7ef63e39
Nov 30 00:02:40 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-cdba9c53-18c8-4081-bc70-12039a48119e tempest-TestVolumeBootPattern-1146673908 tempest-TestVolumeBootPattern-1146673908-project-member] Lock "8f244e30-e5b0-4585-89e4-bd8f7ef63e39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.856s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:02:41 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:02:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:02:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:02:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:02:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:03:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:03:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:03:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:20 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:03:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:03:20 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:03:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:03:22 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9148MB free_disk=24.995845794677734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:03:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:03:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:35 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:38 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 00:03:39 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:44 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:03:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:03:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:03:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:03:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:02 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 00:04:02 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 00:04:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:08 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:11 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:18 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:04:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:04:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:04:23 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:04:23 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=24.982013702392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 00:04:23 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Starting instance... {{(pid=75244) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75244) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 00:04:24 user nova-compute[75244]: INFO nova.compute.claims [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Claim successful on node user
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Start building networks asynchronously for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Allocating IP information in the background. {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] allocate_for_instance() {{(pid=75244) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 00:04:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Start building block device mappings for instance. {{(pid=75244) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.policy [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5e0858b586648f2b50bdfd669925e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5638db6a4a5b4f94814f3c7c4d734bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75244) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Start spawning the instance on the hypervisor. {{(pid=75244) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Creating instance directory {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 00:04:25 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Creating image(s)
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "/opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "/opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "/opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk 1073741824 {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1,backing_fmt=raw /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk 1073741824" returned: 0 in 0.053s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "48cf2b6ea4724f5dea2150601674071272f2e3c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48cf2b6ea4724f5dea2150601674071272f2e3c1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk. size=1073741824 {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:04:25 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Successfully created port: 11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.virt.disk.api [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Cannot resize image /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk to a smaller size. {{(pid=75244) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Created local disks {{(pid=75244) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Ensure instance console log exists: /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/console.log {{(pid=75244) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Successfully updated port: 11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Building network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-changed-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.compute.manager [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Refreshing instance network info cache due to event network-changed-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Instance cache missing network info. {{(pid=75244) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Instance network_info: |[{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75244) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.network.neutron [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Refreshing network info cache for port 11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 00:04:26 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Start _get_guest_xml network_info=[{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'image_id': 'bb216299-2134-4398-939c-137bca845056'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 00:04:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:04:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CPU controller missing on host. {{(pid=75244) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.host [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CPU controller found on host. {{(pid=75244) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75244) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T22:57:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T22:57:57Z,direct_url=<?>,disk_format='qcow2',id=bb216299-2134-4398-939c-137bca845056,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b80290970abc4429ae733e0247e77aa2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T22:57:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Flavor limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Image limits 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Flavor pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Image pref 0:0:0 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Got 1 possible topologies {{(pid=75244) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.hardware [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75244) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T00:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-976794897',display_name='tempest-SnapshotDataIntegrityTests-server-976794897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-976794897',id=53,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1IHQIcIWA+u80/r4PlrzrybEKTlDYihL72wWzOkM5IxVx2Vlf+gWe6L8cMhU8+pJuSaHArkLRGGnWGH0BfWJgrCU4loku+V/5po+hhcdJipKeOBSrN58JTqwR/QWCoTA==',key_name='tempest-keypair-838329802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5638db6a4a5b4f94814f3c7c4d734bf8',ramdisk_id='',reservation_id='r-dcta5b8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2116270979',owner_user_name='tempest-SnapshotDataIntegrityTests-2116270979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T00:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e0858b586648f2b50bdfd669925e83',uuid=22500ec9-33b8-4636-9909-07f0b815388d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75244) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Converting VIF {"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.objects.instance [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'pci_devices' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] End _get_guest_xml xml=<domain type="kvm">
Nov 30 00:04:27 user nova-compute[75244]:   <uuid>22500ec9-33b8-4636-9909-07f0b815388d</uuid>
Nov 30 00:04:27 user nova-compute[75244]:   <name>instance-00000035</name>
Nov 30 00:04:27 user nova-compute[75244]:   <memory>524288</memory>
Nov 30 00:04:27 user nova-compute[75244]:   <vcpu>1</vcpu>
Nov 30 00:04:27 user nova-compute[75244]:   <metadata>
Nov 30 00:04:27 user nova-compute[75244]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 00:04:27 user nova-compute[75244]:       <nova:package version="0.0.0"/>
Nov 30 00:04:27 user nova-compute[75244]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-976794897</nova:name>
Nov 30 00:04:27 user nova-compute[75244]:       <nova:creationTime>2023-11-30 00:04:27</nova:creationTime>
Nov 30 00:04:27 user nova-compute[75244]:       <nova:flavor name="m1.tiny">
Nov 30 00:04:27 user nova-compute[75244]:         <nova:memory>512</nova:memory>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:disk>1</nova:disk>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:swap>0</nova:swap>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:vcpus>1</nova:vcpus>
Nov 30 00:04:27 user nova-compute[75244]:       </nova:flavor>
Nov 30 00:04:27 user nova-compute[75244]:       <nova:owner>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:user uuid="c5e0858b586648f2b50bdfd669925e83">tempest-SnapshotDataIntegrityTests-2116270979-project-member</nova:user>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:project uuid="5638db6a4a5b4f94814f3c7c4d734bf8">tempest-SnapshotDataIntegrityTests-2116270979</nova:project>
Nov 30 00:04:27 user nova-compute[75244]:       </nova:owner>
Nov 30 00:04:27 user nova-compute[75244]:       <nova:root type="image" uuid="bb216299-2134-4398-939c-137bca845056"/>
Nov 30 00:04:27 user nova-compute[75244]:       <nova:ports>
Nov 30 00:04:27 user nova-compute[75244]:         <nova:port uuid="11e58cf5-9b76-4e9f-9e22-2bc76c29ff55">
Nov 30 00:04:27 user nova-compute[75244]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 00:04:27 user nova-compute[75244]:         </nova:port>
Nov 30 00:04:27 user nova-compute[75244]:       </nova:ports>
Nov 30 00:04:27 user nova-compute[75244]:     </nova:instance>
Nov 30 00:04:27 user nova-compute[75244]:   </metadata>
Nov 30 00:04:27 user nova-compute[75244]:   <sysinfo type="smbios">
Nov 30 00:04:27 user nova-compute[75244]:     <system>
Nov 30 00:04:27 user nova-compute[75244]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 00:04:27 user nova-compute[75244]:       <entry name="product">OpenStack Nova</entry>
Nov 30 00:04:27 user nova-compute[75244]:       <entry name="version">0.0.0</entry>
Nov 30 00:04:27 user nova-compute[75244]:       <entry name="serial">22500ec9-33b8-4636-9909-07f0b815388d</entry>
Nov 30 00:04:27 user nova-compute[75244]:       <entry name="uuid">22500ec9-33b8-4636-9909-07f0b815388d</entry>
Nov 30 00:04:27 user nova-compute[75244]:       <entry name="family">Virtual Machine</entry>
Nov 30 00:04:27 user nova-compute[75244]:     </system>
Nov 30 00:04:27 user nova-compute[75244]:   </sysinfo>
Nov 30 00:04:27 user nova-compute[75244]:   <os>
Nov 30 00:04:27 user nova-compute[75244]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 00:04:27 user nova-compute[75244]:     <boot dev="hd"/>
Nov 30 00:04:27 user nova-compute[75244]:     <smbios mode="sysinfo"/>
Nov 30 00:04:27 user nova-compute[75244]:   </os>
Nov 30 00:04:27 user nova-compute[75244]:   <features>
Nov 30 00:04:27 user nova-compute[75244]:     <acpi/>
Nov 30 00:04:27 user nova-compute[75244]:     <apic/>
Nov 30 00:04:27 user nova-compute[75244]:     <vmcoreinfo/>
Nov 30 00:04:27 user nova-compute[75244]:   </features>
Nov 30 00:04:27 user nova-compute[75244]:   <clock offset="utc">
Nov 30 00:04:27 user nova-compute[75244]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 00:04:27 user nova-compute[75244]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 00:04:27 user nova-compute[75244]:     <timer name="hpet" present="no"/>
Nov 30 00:04:27 user nova-compute[75244]:   </clock>
Nov 30 00:04:27 user nova-compute[75244]:   <cpu mode="custom" match="exact">
Nov 30 00:04:27 user nova-compute[75244]:     <model>Nehalem</model>
Nov 30 00:04:27 user nova-compute[75244]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 00:04:27 user nova-compute[75244]:   </cpu>
Nov 30 00:04:27 user nova-compute[75244]:   <devices>
Nov 30 00:04:27 user nova-compute[75244]:     <disk type="file" device="disk">
Nov 30 00:04:27 user nova-compute[75244]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 00:04:27 user nova-compute[75244]:       <source file="/opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk"/>
Nov 30 00:04:27 user nova-compute[75244]:       <target dev="vda" bus="virtio"/>
Nov 30 00:04:27 user nova-compute[75244]:     </disk>
Nov 30 00:04:27 user nova-compute[75244]:     <interface type="ethernet">
Nov 30 00:04:27 user nova-compute[75244]:       <mac address="fa:16:3e:1d:09:43"/>
Nov 30 00:04:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 30 00:04:27 user nova-compute[75244]:       <mtu size="1442"/>
Nov 30 00:04:27 user nova-compute[75244]:       <target dev="tap11e58cf5-9b"/>
Nov 30 00:04:27 user nova-compute[75244]:     </interface>
Nov 30 00:04:27 user nova-compute[75244]:     <serial type="pty">
Nov 30 00:04:27 user nova-compute[75244]:       <log file="/opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/console.log" append="off"/>
Nov 30 00:04:27 user nova-compute[75244]:     </serial>
Nov 30 00:04:27 user nova-compute[75244]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 00:04:27 user nova-compute[75244]:     <video>
Nov 30 00:04:27 user nova-compute[75244]:       <model type="virtio"/>
Nov 30 00:04:27 user nova-compute[75244]:     </video>
Nov 30 00:04:27 user nova-compute[75244]:     <rng model="virtio">
Nov 30 00:04:27 user nova-compute[75244]:       <backend model="random">/dev/urandom</backend>
Nov 30 00:04:27 user nova-compute[75244]:     </rng>
Nov 30 00:04:27 user nova-compute[75244]:     <controller type="usb" index="0" model="none"/>
Nov 30 00:04:27 user nova-compute[75244]:     <memballoon model="virtio">
Nov 30 00:04:27 user nova-compute[75244]:       <stats period="10"/>
Nov 30 00:04:27 user nova-compute[75244]:     </memballoon>
Nov 30 00:04:27 user nova-compute[75244]:   </devices>
Nov 30 00:04:27 user nova-compute[75244]: </domain>
Nov 30 00:04:27 user nova-compute[75244]:  {{(pid=75244) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T00:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-976794897',display_name='tempest-SnapshotDataIntegrityTests-server-976794897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-976794897',id=53,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1IHQIcIWA+u80/r4PlrzrybEKTlDYihL72wWzOkM5IxVx2Vlf+gWe6L8cMhU8+pJuSaHArkLRGGnWGH0BfWJgrCU4loku+V/5po+hhcdJipKeOBSrN58JTqwR/QWCoTA==',key_name='tempest-keypair-838329802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5638db6a4a5b4f94814f3c7c4d734bf8',ramdisk_id='',reservation_id='r-dcta5b8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2116270979',owner_user_name='tempest-SnapshotDataIntegrityTests-2116270979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T00:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e0858b586648f2b50bdfd669925e83',uuid=22500ec9-33b8-4636-9909-07f0b815388d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Converting VIF {"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG os_vif [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b') {{(pid=75244) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cc3b1a6-4b6c-58f5-a60f-c6d5b498fe8e', '_type': 'linux-noop'}}, row=False) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11e58cf5-9b, may_exist=True, interface_attrs={}) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11e58cf5-9b, col_values=(('qos', UUID('38e468a9-e911-4c89-ad3a-084e4fefeb60')),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11e58cf5-9b, col_values=(('external_ids', {'iface-id': '11e58cf5-9b76-4e9f-9e22-2bc76c29ff55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:09:43', 'vm-uuid': '22500ec9-33b8-4636-9909-07f0b815388d'}),), if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:27 user nova-compute[75244]: INFO os_vif [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b')
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No VIF found with MAC fa:16:3e:1d:09:43, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.network.neutron [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated VIF entry in instance network info cache for port 11e58cf5-9b76-4e9f-9e22-2bc76c29ff55. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG nova.network.neutron [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:04:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-3346c568-a96c-4247-9ea0-9393b48a91ef req-d872005e-2356-4f6b-b8d2-6778f45ae3e6 service nova] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b3b2c396-3278-4fca-be07-2a1b66972cb0 req-09b31a39-b8f8-42d3-8614-c200cc085ec1 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b3b2c396-3278-4fca-be07-2a1b66972cb0 req-09b31a39-b8f8-42d3-8614-c200cc085ec1 service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b3b2c396-3278-4fca-be07-2a1b66972cb0 req-09b31a39-b8f8-42d3-8614-c200cc085ec1 service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-b3b2c396-3278-4fca-be07-2a1b66972cb0 req-09b31a39-b8f8-42d3-8614-c200cc085ec1 service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:28 user nova-compute[75244]: DEBUG nova.compute.manager [req-b3b2c396-3278-4fca-be07-2a1b66972cb0 req-09b31a39-b8f8-42d3-8614-c200cc085ec1 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:04:28 user nova-compute[75244]: WARNING nova.compute.manager [req-b3b2c396-3278-4fca-be07-2a1b66972cb0 req-09b31a39-b8f8-42d3-8614-c200cc085ec1 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state building and task_state spawning.
Nov 30 00:04:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:29 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-592a2f81-e7d4-4aa7-8541-9b85103ad95d req-efd86861-1015-4a6d-92d4-5bc39b30806b service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-592a2f81-e7d4-4aa7-8541-9b85103ad95d req-efd86861-1015-4a6d-92d4-5bc39b30806b service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-592a2f81-e7d4-4aa7-8541-9b85103ad95d req-efd86861-1015-4a6d-92d4-5bc39b30806b service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-592a2f81-e7d4-4aa7-8541-9b85103ad95d req-efd86861-1015-4a6d-92d4-5bc39b30806b service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [req-592a2f81-e7d4-4aa7-8541-9b85103ad95d req-efd86861-1015-4a6d-92d4-5bc39b30806b service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:04:30 user nova-compute[75244]: WARNING nova.compute.manager [req-592a2f81-e7d4-4aa7-8541-9b85103ad95d req-efd86861-1015-4a6d-92d4-5bc39b30806b service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state building and task_state spawning.
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Instance event wait completed in 0 seconds for  {{(pid=75244) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Guest created on hypervisor {{(pid=75244) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 00:04:30 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Instance spawned successfully.
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Found default for hw_cdrom_bus of ide {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Found default for hw_disk_bus of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Found default for hw_input_bus of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Found default for hw_pointer_model of None {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Found default for hw_video_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Found default for hw_vif_model of virtio {{(pid=75244) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 00:04:30 user nova-compute[75244]: INFO nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 30 00:04:30 user nova-compute[75244]: DEBUG nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Checking state {{(pid=75244) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 00:04:31 user nova-compute[75244]: INFO nova.compute.manager [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Took 6.40 seconds to build instance.
Nov 30 00:04:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-e0a2610b-4c09-497d-9583-c8027b447c21 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:04:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:38 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:44 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:04:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:04:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:04:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:05:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:05:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:05:23 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:05:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:05:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:05:24 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:05:25 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:05:25 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=24.949569702148438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 22500ec9-33b8-4636-9909-07f0b815388d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:05:25 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:05:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:05:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:40 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:05:46 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:05:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:05:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:05:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:06:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:06:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:06:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:06:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:06:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:06:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-changed-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG nova.compute.manager [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Refreshing instance network info cache due to event network-changed-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55. {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Refreshing network info cache for port 11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated VIF entry in instance network info cache for port 11e58cf5-9b76-4e9f-9e22-2bc76c29ff55. {{(pid=75244) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG nova.network.neutron [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-fda80693-d7db-4aaa-a765-3fee163b50c8 req-1c0ad081-4f8a-4916-ae10-9b23ddd3964a service nova] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:06:16 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG nova.objects.instance [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:06:19 user nova-compute[75244]: INFO nova.compute.manager [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attaching volume 3b20aaea-706b-4eac-9aaa-8f1954d408ab to /dev/vdb
Nov 30 00:06:19 user nova-compute[75244]: DEBUG os_brick.utils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbdd40-2111-4542-bb30-633e6a84cbfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4cd174-05b2-41a2-b30a-9676111f57b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad007c-6704-4535-91e4-407a2af7f439]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8268f-6603-4563-b641-9e27671a4452]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:06:19 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 00:06:19 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ee543-1bc3-4be0-a063-baba07ecd434]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG os_brick.utils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:06:19 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating existing volume attachment record: 35d503f2-5946-42b0-82f6-852a6d743baa {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 00:06:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:06:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:06:23 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:06:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:06:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:26 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyuBVNmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:06:27 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:06:27 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:06:27 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:06:27 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.940597534179688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea68d52-c8fe-4523-b977-5426744c185f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 00:06:27 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece22f2-f0cc-44b5-bd14-f9ce3c8e6add]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab] added
Nov 30 00:06:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1910e7-32e9-491f-9f9e-93b2eb8dfa74]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d08895-2886-46a9-97e1-830e02af0fc5]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyuBVNmH {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyuBVNmH" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3c6b39-29d9-47e1-bc2d-1ccfd85c618c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyuBVNmH'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[905cdcee-ecab-4b96-b22d-dbbe428e5767]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a37b15-85e9-4ba6-85c5-4dd10b68ece7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:06:27 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:06:27 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:06:27 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 00:06:27 user nova-compute[75244]: 
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 22500ec9-33b8-4636-9909-07f0b815388d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb86b2a-2c21-4358-9b2f-5222493f84d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260]
Nov 30 00:06:27 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260] successful.
Nov 30 00:06:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad12ac8-6b46-41e2-abf8-4eec9f88be4c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b776e7d-edb9-4040-9fbb-0a4046a0e51c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab (non-flash)
Nov 30 00:06:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab (non-flash)
Nov 30 00:06:27 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a8f027-cbda-4be9-b7b0-bc8f11b35763]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 00:06:27 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyuBVNmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23963376463633934', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963376463633934', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG nova.objects.instance [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 00:06:28 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:06:28 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:06:28 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:06:28 user nova-compute[75244]:   <serial>3b20aaea-706b-4eac-9aaa-8f1954d408ab</serial>
Nov 30 00:06:28 user nova-compute[75244]: </disk>
Nov 30 00:06:28 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:06:28 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No VIF found with MAC fa:16:3e:1d:09:43, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 00:06:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-12bf1fb4-3567-4dda-a47d-6a87cb8367bd tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.287s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:06:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:31 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:36 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:39 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:06:45 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:06:45 user nova-compute[75244]: INFO nova.compute.manager [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Detaching volume 3b20aaea-706b-4eac-9aaa-8f1954d408ab
Nov 30 00:06:45 user nova-compute[75244]: INFO nova.virt.block_device [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attempting to driver detach volume 3b20aaea-706b-4eac-9aaa-8f1954d408ab from mountpoint /dev/vdb
Nov 30 00:06:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Attempting to detach device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 00:06:45 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:06:45 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:06:45 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:06:45 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:06:45 user nova-compute[75244]:   <serial>3b20aaea-706b-4eac-9aaa-8f1954d408ab</serial>
Nov 30 00:06:45 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:06:45 user nova-compute[75244]: </disk>
Nov 30 00:06:45 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:06:46 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config.
Nov 30 00:06:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 00:06:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:06:46 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:06:46 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:06:46 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:06:46 user nova-compute[75244]:   <serial>3b20aaea-706b-4eac-9aaa-8f1954d408ab</serial>
Nov 30 00:06:46 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:06:46 user nova-compute[75244]: </disk>
Nov 30 00:06:46 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:06:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 00:06:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:06:48 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:06:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:06:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:07:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:06 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d is timed out.
Nov 30 00:07:06 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config.
Nov 30 00:07:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyuBVNmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:07:06 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53f877-7fd4-4856-938b-e11299282b1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 00:07:06 user nova-compute[75244]: No targets found.
Nov 30 00:07:06 user nova-compute[75244]: iSNS:
Nov 30 00:07:06 user nova-compute[75244]: No targets found.
Nov 30 00:07:06 user nova-compute[75244]: STATIC:
Nov 30 00:07:06 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab
Nov 30 00:07:06 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:07:06 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:07:06 user nova-compute[75244]: FIRMWARE:
Nov 30 00:07:06 user nova-compute[75244]: No targets found.
Nov 30 00:07:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 00:07:06 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 00:07:06 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac94f2-fbad-452f-8973-305816dcf327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36fc327-447c-4caf-9e21-7778a2ad2e2a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab (non-flash)
Nov 30 00:07:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab (non-flash)
Nov 30 00:07:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c32e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fca31-a761-435b-b888-fa8ea9205062]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85b5f0-88d2-40d8-b926-7d89c3b3c04b]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db70e79-c2e9-483d-8f4a-a20938aba60e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcece66-6a8e-40ce-8880-9b5fcd2ac0d7]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f424c057-d86a-41e6-a25d-78049b0b9994]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d570c6d-3c65-411a-a172-f2a351010000]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260]
Nov 30 00:07:06 user nova-compute[75244]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab, portal: 172.16.0.220,3260] successful.
Nov 30 00:07:06 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20aaea-706b-4eac-9aaa-8f1954d408ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[547cc74e-4f82-4b13-9c21-1df8006d1533]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== disconnect_volume: return (309ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:07:06 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 00:07:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:07 user nova-compute[75244]: DEBUG nova.objects.instance [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:07:07 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-3bdeba0b-19f7-49a1-a03d-c83833bc2d01 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:07:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:07:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:07:22 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:07:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:07:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:07:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=24.939502716064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 22500ec9-33b8-4636-9909-07f0b815388d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:07:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:07:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:07:38 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:07:38 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:07:39 user nova-compute[75244]: INFO nova.compute.manager [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attaching volume dd70084a-7525-444f-877f-9a1bc53a21cf to /dev/vdb
Nov 30 00:07:39 user nova-compute[75244]: DEBUG os_brick.utils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc750295-9935-4256-9d7e-468bdb50a4a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0122594-c573-4abe-8697-8b89d57b40d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8112e1fb-6e96-46c5-859a-0cb3aee8782b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c279e14-e3c3-4625-bbe0-8b2a4860a62d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:07:39 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 00:07:39 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6147dfd-b202-4e67-bda8-8b562e4affef]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG os_brick.utils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:07:39 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating existing volume attachment record: 527a5c4d-0649-4a98-b558-20dd905d6b4e {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 00:07:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:41 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXyHkjRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:07:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:07:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:07:46 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[319fea5f-242e-4e63-a167-217f90cc00e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 00:07:46 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc6efee-f39b-465e-a68a-d9defe86957b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf] added
Nov 30 00:07:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1ef1e-8991-4367-a70b-7db24904d932]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[371efc21-4b94-470f-8449-ddbd3474f78c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXyHkjRd {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXyHkjRd" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a725b-d01f-468f-81d7-a837674c070d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXyHkjRd'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7623dd-775d-4a62-a05e-7620d2179b5c]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b44e1b-8570-4036-b473-c2739b934729]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:07:46 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:07:46 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:07:46 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 00:07:46 user nova-compute[75244]: 
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe75e30-9902-4eec-9b53-a6b4d3fa53c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260]
Nov 30 00:07:46 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260] successful.
Nov 30 00:07:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[74368869-ec7e-4659-a92d-290e9e3360fe]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82de62ad-e087-4361-9832-3c9167a5dbb9]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf (non-flash)
Nov 30 00:07:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf (non-flash)
Nov 30 00:07:46 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5baab91-0518-4fe4-8a35-5cfa4948d3ef]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 00:07:46 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXyHkjRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23938653163313366', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938653163313366', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG nova.objects.instance [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:07:47 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 00:07:47 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:07:47 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:07:47 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:07:47 user nova-compute[75244]:   <serial>dd70084a-7525-444f-877f-9a1bc53a21cf</serial>
Nov 30 00:07:47 user nova-compute[75244]: </disk>
Nov 30 00:07:47 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 00:07:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:07:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:07:48 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No VIF found with MAC fa:16:3e:1d:09:43, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 00:07:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-c78dd429-876b-476c-a0cb-4e6dc507e087 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.314s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:07:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:07:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:07:50 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:07:50 user nova-compute[75244]: INFO nova.compute.manager [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Detaching volume dd70084a-7525-444f-877f-9a1bc53a21cf
Nov 30 00:07:50 user nova-compute[75244]: INFO nova.virt.block_device [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attempting to driver detach volume dd70084a-7525-444f-877f-9a1bc53a21cf from mountpoint /dev/vdb
Nov 30 00:07:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Attempting to detach device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 00:07:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:07:50 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:07:50 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:07:50 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:07:50 user nova-compute[75244]:   <serial>dd70084a-7525-444f-877f-9a1bc53a21cf</serial>
Nov 30 00:07:50 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:07:50 user nova-compute[75244]: </disk>
Nov 30 00:07:50 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:07:50 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config.
Nov 30 00:07:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 00:07:50 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:07:50 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:07:50 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:07:50 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:07:50 user nova-compute[75244]:   <serial>dd70084a-7525-444f-877f-9a1bc53a21cf</serial>
Nov 30 00:07:50 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:07:50 user nova-compute[75244]: </disk>
Nov 30 00:07:50 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:07:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 00:07:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:07:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:08:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:11 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d is timed out.
Nov 30 00:08:11 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config.
Nov 30 00:08:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXyHkjRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:08:11 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bfed0-1591-44f6-8152-406dc6d15464]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 00:08:11 user nova-compute[75244]: No targets found.
Nov 30 00:08:11 user nova-compute[75244]: iSNS:
Nov 30 00:08:11 user nova-compute[75244]: No targets found.
Nov 30 00:08:11 user nova-compute[75244]: STATIC:
Nov 30 00:08:11 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf
Nov 30 00:08:11 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:08:11 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:08:11 user nova-compute[75244]: FIRMWARE:
Nov 30 00:08:11 user nova-compute[75244]: No targets found.
Nov 30 00:08:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 00:08:11 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 00:08:11 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167c56c-48cc-4160-aad1-219a25c8c334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1951a3-304c-408b-84d2-0087b079c8b3]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf (non-flash)
Nov 30 00:08:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf (non-flash)
Nov 30 00:08:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa804460c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d6a24d-bac3-4825-a353-7badef6908e4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcc88f8-67df-449a-b07c-d8fa02264dc4]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6ec26-a18e-408b-82fc-c089d93e3b08]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61e515-4d4a-44ff-99b2-55a8478d6592]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[799b2269-65d2-4ff3-8e44-a49e272771a8]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee3ebb0-54ff-43d0-a297-3b14626b3a63]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260]
Nov 30 00:08:11 user nova-compute[75244]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf, portal: 172.16.0.220,3260] successful.
Nov 30 00:08:11 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd70084a-7525-444f-877f-9a1bc53a21cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9dc470-c231-40c3-98cf-379ea6e65be2]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== disconnect_volume: return (258ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:08:11 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG nova.objects.instance [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-f5d3bd3e-a833-4b01-abd9-28d3fae921ad tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:08:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:08:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:08:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:08:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:08:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:08:23 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:08:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:28 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:08:29 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=24.938575744628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 22500ec9-33b8-4636-9909-07f0b815388d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:08:29 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:08:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:08:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:40 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 00:08:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:08:43 user nova-compute[75244]: INFO nova.compute.manager [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attaching volume 6aed3439-48ee-4e86-afc6-63903b1836a6 to /dev/vdb
Nov 30 00:08:43 user nova-compute[75244]: DEBUG os_brick.utils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8041751-da42-4d3c-bf3c-7ef5e752a402]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c03c940-83a8-4829-b1a8-a932c4d5f8aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[db701d37-317e-4885-b919-6c57164e4afa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef86d91-ed7f-40b0-a273-a24379085d02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:08:43 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 00:08:43 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2288c0-8f3b-49ba-943f-c2baa497572f]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG os_brick.utils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:08:43 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating existing volume attachment record: 4bbaa9f9-6fa6-4bf5-8958-d7cda5250197 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 00:08:46 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:47 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:08:50 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFXwfTqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:08:51 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:08:51 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:08:51 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c8155a-9002-4204-bfca-40aca59e0220]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 00:08:51 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c890a8-08d7-4c35-b4e3-5f5a347a30c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6] added
Nov 30 00:08:51 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfdff7e-a9e2-44e6-b30e-681dc1010d64]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3409c-b07d-4ea8-9f97-e71528132fbd]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFXwfTqg {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFXwfTqg" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dabcded-6f0b-4bb2-9895-bd5be386b406]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFXwfTqg'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b52527-ad80-439b-84fc-1fb144b786fe]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9113e3-4261-448a-b366-f9ad3c5a5fa6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:08:51 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:08:51 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:08:51 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 00:08:51 user nova-compute[75244]: 
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c609bb73-aa33-444d-98c7-019b7039efa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260]
Nov 30 00:08:51 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260] successful.
Nov 30 00:08:51 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d72f66-ff23-48d3-a9fd-7c9ad27e98c4]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c094713-aad9-4ce3-847f-e5a73da15071]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 (non-flash)
Nov 30 00:08:51 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 (non-flash)
Nov 30 00:08:51 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4042d1d3-83ff-447f-8e07-18f067de7b86]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFXwfTqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 00:08:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23364346661653334', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364346661653334', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 00:08:52 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:08:52 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:08:52 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:08:52 user nova-compute[75244]:   <serial>6aed3439-48ee-4e86-afc6-63903b1836a6</serial>
Nov 30 00:08:52 user nova-compute[75244]: </disk>
Nov 30 00:08:52 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:08:52 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No VIF found with MAC fa:16:3e:1d:09:43, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 00:08:53 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5be04dac-d007-4416-b358-8cf4ee21fe76 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.341s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:08:54 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:08:54 user nova-compute[75244]: INFO nova.compute.manager [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Detaching volume 6aed3439-48ee-4e86-afc6-63903b1836a6
Nov 30 00:08:55 user nova-compute[75244]: INFO nova.virt.block_device [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attempting to driver detach volume 6aed3439-48ee-4e86-afc6-63903b1836a6 from mountpoint /dev/vdb
Nov 30 00:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Attempting to detach device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 00:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:08:55 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:08:55 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:08:55 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:08:55 user nova-compute[75244]:   <serial>6aed3439-48ee-4e86-afc6-63903b1836a6</serial>
Nov 30 00:08:55 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:08:55 user nova-compute[75244]: </disk>
Nov 30 00:08:55 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:08:55 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config.
Nov 30 00:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 00:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:08:55 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:08:55 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:08:55 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:08:55 user nova-compute[75244]:   <serial>6aed3439-48ee-4e86-afc6-63903b1836a6</serial>
Nov 30 00:08:55 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:08:55 user nova-compute[75244]: </disk>
Nov 30 00:08:55 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:08:55 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 00:08:56 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:08:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:00 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:09:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:09:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:09:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:14 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 00:09:14 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] There are 0 instances to clean {{(pid=75244) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 00:09:15 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d is timed out.
Nov 30 00:09:15 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config.
Nov 30 00:09:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFXwfTqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:09:15 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc41ea1-1b0f-4eac-9ec4-7a480609a14b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 00:09:15 user nova-compute[75244]: No targets found.
Nov 30 00:09:15 user nova-compute[75244]: iSNS:
Nov 30 00:09:15 user nova-compute[75244]: No targets found.
Nov 30 00:09:15 user nova-compute[75244]: STATIC:
Nov 30 00:09:15 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6
Nov 30 00:09:15 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:09:15 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:09:15 user nova-compute[75244]: FIRMWARE:
Nov 30 00:09:15 user nova-compute[75244]: No targets found.
Nov 30 00:09:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 00:09:15 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 00:09:15 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a153df7-151c-4bfa-9553-241a0d7ee31b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[39123f29-7bee-4d6c-9dc7-9dee14cbd953]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 (non-flash)
Nov 30 00:09:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 (non-flash)
Nov 30 00:09:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa80c476050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ba2c30-ff80-4834-9c3b-07169bef07ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dc6519-8930-4491-98f6-2693c4200871]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d30462-a765-4402-aa1b-50a9dbce4d88]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c4a496-defb-4007-9083-28a65049b2c6]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f539363-b23e-42a6-9a87-79e878554621]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356e81f-7a59-48a7-bd6d-67940c8cf1cb]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260]
Nov 30 00:09:15 user nova-compute[75244]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6, portal: 172.16.0.220,3260] successful.
Nov 30 00:09:15 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aed3439-48ee-4e86-afc6-63903b1836a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c401a98-68a9-4dc9-afc4-b4bc207f4c1b]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== disconnect_volume: return (307ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:09:15 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 00:09:16 user nova-compute[75244]: DEBUG nova.objects.instance [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:09:16 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-5d5bdb6c-c40f-4ccc-99d2-b89931a751c2 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:09:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:18 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:18 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Triggering sync for uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 00:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:09:18 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:09:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:09:24 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:09:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:09:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:09:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:09:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:30 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:31 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:09:31 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.937583923339844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 22500ec9-33b8-4636-9909-07f0b815388d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing inventories for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating ProviderTree inventory for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Updating inventory in ProviderTree for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing aggregate associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, aggregates: None {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Refreshing trait associations for resource provider cc9d5100-ee82-415a-9911-9d1a045bcd6b, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75244) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:09:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:09:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:32 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:09:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:09:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:09:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:09:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:09:48 user nova-compute[75244]: DEBUG nova.objects.instance [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:09:48 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:09:48 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:09:49 user nova-compute[75244]: INFO nova.compute.manager [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attaching volume 5903d741-4237-468e-982f-268f68d8f04f to /dev/vdb
Nov 30 00:09:49 user nova-compute[75244]: DEBUG os_brick.utils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57dc8a1-9592-43ba-b02e-ad306ab468ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e068b35230af\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[74696b47-22bc-45e4-b85e-593e2044582f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499aef4-3283-48c6-a3c4-cce10b127f27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[61327f21-ccb5-44ca-ab42-98e179e08ce5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Running cmd (subprocess): nvme version {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] 'nvme version' failed. Not Retrying. {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.nvmeof [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] nvme not present on system {{(pid=75244) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 00:09:49 user nova-compute[75244]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 00:09:49 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[11664c1e-ae52-44fe-90a0-e43ae1d8df8e]: (4, '') {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75244) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.lightos [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] LIGHTOS: no hostnqn found. {{(pid=75244) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG os_brick.utils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e068b35230af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:09:49 user nova-compute[75244]: DEBUG nova.virt.block_device [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating existing volume attachment record: bbf5ca13-d5ff-4c90-a1ca-526a55fe9d86 {{(pid=75244) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 00:09:51 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:09:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:09:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Calling os-brick to attach iSCSI Volume {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrtfhcMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:09:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:09:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:09:56 user nova-compute[75244]: INFO os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0de227e-8e51-4149-85bd-1caadea0b63a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 00:09:56 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --interface default --op new {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fda8227-e0bf-451b-a2af-6dcca1841022]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f] added\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f] added
Nov 30 00:09:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936f412-44fb-4b7a-94d1-f006adeb4115]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[78129065-6092-41d8-be7b-b4503a48f3be]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TrtfhcMs {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TrtfhcMs" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a465cc-cd97-4d15-a0b6-6b104d2bfb9d]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TrtfhcMs'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3637fe-a015-43c1-9433-36cadb2c8b4e]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd70c5db-fe6a-40a8-b5ca-dc005f72b175]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:09:56 user nova-compute[75244]:  {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 00:09:56 user nova-compute[75244]:  {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:09:56 user nova-compute[75244]: WARNING os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 00:09:56 user nova-compute[75244]: 
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --login {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d01bd-d019-4135-89bb-3d0ac18254f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260]
Nov 30 00:09:56 user nova-compute[75244]: Login to [iface: default, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260] successful.
Nov 30 00:09:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ac2e9-b454-43c2-ab7a-e80a7ad113bf]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e95f5b-072d-4bc8-b05f-ba5403a30395]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f (non-flash)
Nov 30 00:09:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f (non-flash)
Nov 30 00:09:56 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to 172.16.0.220:3260 {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75244) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75244) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6296965-07d7-4619-96af-bd4b05908587]: (4, ('- - 0', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75244) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 00:09:56 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrtfhcMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75244) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 00:09:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:09:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:09:57 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23239653631663462', 'path': '/dev/sdb'} {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:09:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239653631663462', 'path': '/dev/sdb'} {{(pid=75244) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 00:09:57 user nova-compute[75244]: DEBUG nova.objects.instance [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:09:57 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 00:09:57 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:09:57 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:09:57 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:09:57 user nova-compute[75244]:   <serial>5903d741-4237-468e-982f-268f68d8f04f</serial>
Nov 30 00:09:57 user nova-compute[75244]: </disk>
Nov 30 00:09:57 user nova-compute[75244]:  {{(pid=75244) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 00:09:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vda, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:09:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75244) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 00:09:58 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] No VIF found with MAC fa:16:3e:1d:09:43, not building metadata {{(pid=75244) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 00:09:58 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-188aca2b-eed0-4f1c-b4e5-3f594632f5b3 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.377s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:10:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:10:00 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:10:00 user nova-compute[75244]: INFO nova.compute.manager [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Detaching volume 5903d741-4237-468e-982f-268f68d8f04f
Nov 30 00:10:00 user nova-compute[75244]: INFO nova.virt.block_device [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Attempting to driver detach volume 5903d741-4237-468e-982f-268f68d8f04f from mountpoint /dev/vdb
Nov 30 00:10:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Attempting to detach device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config. {{(pid=75244) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 00:10:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:10:00 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:10:00 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:10:00 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:10:00 user nova-compute[75244]:   <serial>5903d741-4237-468e-982f-268f68d8f04f</serial>
Nov 30 00:10:00 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:10:00 user nova-compute[75244]: </disk>
Nov 30 00:10:00 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:10:00 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the persistent domain config.
Nov 30 00:10:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config. {{(pid=75244) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 00:10:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.guest [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 00:10:00 user nova-compute[75244]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 00:10:00 user nova-compute[75244]:   <source dev="/dev/sdb"/>
Nov 30 00:10:00 user nova-compute[75244]:   <target dev="vdb" bus="virtio"/>
Nov 30 00:10:00 user nova-compute[75244]:   <serial>5903d741-4237-468e-982f-268f68d8f04f</serial>
Nov 30 00:10:00 user nova-compute[75244]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 00:10:00 user nova-compute[75244]: </disk>
Nov 30 00:10:00 user nova-compute[75244]:  {{(pid=75244) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 00:10:00 user nova-compute[75244]: DEBUG nova.virt.libvirt.driver [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 00:10:01 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:10:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:20 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22500ec9-33b8-4636-9909-07f0b815388d is timed out.
Nov 30 00:10:20 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully detached device vdb from instance 22500ec9-33b8-4636-9909-07f0b815388d from the live domain config.
Nov 30 00:10:20 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] calling os-brick to detach iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 00:10:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa8047690f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrtfhcMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 00:10:20 user nova-compute[75244]: WARNING os_brick.initiator.connectors.base [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 00:10:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 00:10:20 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 00:10:20 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd71536-5cca-43de-8e6c-ca14aa74a60b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 00:10:21 user nova-compute[75244]: No targets found.
Nov 30 00:10:21 user nova-compute[75244]: iSNS:
Nov 30 00:10:21 user nova-compute[75244]: No targets found.
Nov 30 00:10:21 user nova-compute[75244]: STATIC:
Nov 30 00:10:21 user nova-compute[75244]: Target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f
Nov 30 00:10:21 user nova-compute[75244]:         Portal: 172.16.0.220:3260,-1
Nov 30 00:10:21 user nova-compute[75244]:                 Iface Name: default
Nov 30 00:10:21 user nova-compute[75244]: FIRMWARE:
Nov 30 00:10:21 user nova-compute[75244]: No targets found.
Nov 30 00:10:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 00:10:21 user nova-compute[75244]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 00:10:21 user nova-compute[75244]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75244) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f', 0)] {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[723d0ea3-96a9-42f8-809e-0368409bfe82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[851da5d3-fe36-40ff-88da-ebb1be725734]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f (non-flash)\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f (non-flash)
Nov 30 00:10:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f (non-flash)
Nov 30 00:10:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa8043ddab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f'): ({'sdb'}, set())}) {{(pid=75244) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Removing single pathed devices sdb {{(pid=75244) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74dac39-dc2d-4f4d-89ce-707f700917e9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad301e32-ca62-44a0-8d66-4a5921ebbc37]: (4, ('ok\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Flushing IO for device /dev/sdb {{(pid=75244) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8f3b9-c300-4af5-bfce-3773846fff21]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75244) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[659b6442-a68e-497d-9472-12863a1e09ce]: (4, ('1', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.linuxscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] SCSI volumes sdb have been removed. {{(pid=75244) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f')] {{(pid=75244) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aea794-96bf-4024-a375-e26d3361bf58]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --logout {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[b399f4cc-d5b7-4b05-9d03-6778a20b48d9]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260]
Nov 30 00:10:21 user nova-compute[75244]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f, portal: 172.16.0.220,3260] successful.
Nov 30 00:10:21 user nova-compute[75244]:  stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op delete {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5903d741-4237-468e-982f-268f68d8f04f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e19fadf-415e-4a07-974d-b307c9842375]: (4, ('', '')) {{(pid=86356) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75244) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.base [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] <== disconnect_volume: return (302ms) None {{(pid=75244) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 00:10:21 user nova-compute[75244]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Disconnected iSCSI Volume {{(pid=75244) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'flavor' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-2b2beeef-a638-4e36-8faa-27e92ad456e4 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:10:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquired lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Forcefully refreshing network info cache for instance {{(pid=75244) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG nova.objects.instance [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lazy-loading 'info_cache' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:10:26 user nova-compute[75244]: DEBUG nova.network.neutron [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [{"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Releasing lock "refresh_cache-22500ec9-33b8-4636-9909-07f0b815388d" {{(pid=75244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updated the network info_cache for instance {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:10:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 00:10:31 user nova-compute[75244]: DEBUG oslo_concurrency.processutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 00:10:32 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:10:32 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.940200805664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Instance 22500ec9-33b8-4636-9909-07f0b815388d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75244) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:10:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:10:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:37 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:42 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:10:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:52 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:10:52 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:10:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:10:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:21 user nova-compute[75244]: INFO nova.compute.manager [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Terminating instance
Nov 30 00:11:21 user nova-compute[75244]: DEBUG nova.compute.manager [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Start destroying the instance on the hypervisor. {{(pid=75244) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-86b3e8cc-0e78-47fb-a858-59f5153edf90 req-0f9b5c5b-b750-49f6-8ec7-5e7b94658627 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-unplugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86b3e8cc-0e78-47fb-a858-59f5153edf90 req-0f9b5c5b-b750-49f6-8ec7-5e7b94658627 service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86b3e8cc-0e78-47fb-a858-59f5153edf90 req-0f9b5c5b-b750-49f6-8ec7-5e7b94658627 service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-86b3e8cc-0e78-47fb-a858-59f5153edf90 req-0f9b5c5b-b750-49f6-8ec7-5e7b94658627 service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-86b3e8cc-0e78-47fb-a858-59f5153edf90 req-0f9b5c5b-b750-49f6-8ec7-5e7b94658627 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-unplugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG nova.compute.manager [req-86b3e8cc-0e78-47fb-a858-59f5153edf90 req-0f9b5c5b-b750-49f6-8ec7-5e7b94658627 service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-unplugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with task_state deleting. {{(pid=75244) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 00:11:21 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: INFO nova.virt.libvirt.driver [-] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Instance destroyed successfully.
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG nova.objects.instance [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lazy-loading 'resources' on Instance uuid 22500ec9-33b8-4636-9909-07f0b815388d {{(pid=75244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG nova.virt.libvirt.vif [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T00:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-976794897',display_name='tempest-SnapshotDataIntegrityTests-server-976794897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-976794897',id=53,image_ref='bb216299-2134-4398-939c-137bca845056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1IHQIcIWA+u80/r4PlrzrybEKTlDYihL72wWzOkM5IxVx2Vlf+gWe6L8cMhU8+pJuSaHArkLRGGnWGH0BfWJgrCU4loku+V/5po+hhcdJipKeOBSrN58JTqwR/QWCoTA==',key_name='tempest-keypair-838329802',keypairs=<?>,launch_index=0,launched_at=2023-11-30T00:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5638db6a4a5b4f94814f3c7c4d734bf8',ramdisk_id='',reservation_id='r-dcta5b8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb216299-2134-4398-939c-137bca845056',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2116270979',owner_user_name='tempest-SnapshotDataIntegrityTests-2116270979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T00:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e0858b586648f2b50bdfd669925e83',uuid=22500ec9-33b8-4636-9909-07f0b815388d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Converting VIF {"id": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "address": "fa:16:3e:1d:09:43", "network": {"id": "a9448d33-a488-4077-b9f7-59a24a1d1060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-674980755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5638db6a4a5b4f94814f3c7c4d734bf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e58cf5-9b", "ovs_interfaceid": "11e58cf5-9b76-4e9f-9e22-2bc76c29ff55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG nova.network.os_vif_util [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b') {{(pid=75244) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG os_vif [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b') {{(pid=75244) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11e58cf5-9b, bridge=br-int, if_exists=True) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38e468a9-e911-4c89-ad3a-084e4fefeb60) {{(pid=75244) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:22 user nova-compute[75244]: INFO os_vif [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:09:43,bridge_name='br-int',has_traffic_filtering=True,id=11e58cf5-9b76-4e9f-9e22-2bc76c29ff55,network=Network(a9448d33-a488-4077-b9f7-59a24a1d1060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e58cf5-9b')
Nov 30 00:11:22 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Deleting instance files /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d_del
Nov 30 00:11:22 user nova-compute[75244]: INFO nova.virt.libvirt.driver [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Deletion of /opt/stack/data/nova/instances/22500ec9-33b8-4636-9909-07f0b815388d_del complete
Nov 30 00:11:22 user nova-compute[75244]: INFO nova.compute.manager [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 30 00:11:22 user nova-compute[75244]: DEBUG oslo.service.loopingcall [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75244) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG nova.compute.manager [-] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Deallocating network for instance {{(pid=75244) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] deallocate_for_instance() {{(pid=75244) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.network.neutron [-] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Updating instance_info_cache with network_info: [] {{(pid=75244) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 00:11:23 user nova-compute[75244]: INFO nova.compute.manager [-] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Took 1.24 seconds to deallocate network for instance.
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:23 user nova-compute[75244]: INFO nova.scheduler.client.report [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Deleted allocations for instance 22500ec9-33b8-4636-9909-07f0b815388d
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:11:23 user nova-compute[75244]: WARNING nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state deleted and task_state None.
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:11:23 user nova-compute[75244]: WARNING nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state deleted and task_state None.
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:11:23 user nova-compute[75244]: WARNING nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state deleted and task_state None.
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-unplugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-unplugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:11:23 user nova-compute[75244]: WARNING nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-unplugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state deleted and task_state None.
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Acquiring lock "22500ec9-33b8-4636-9909-07f0b815388d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] Lock "22500ec9-33b8-4636-9909-07f0b815388d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] No waiting events found dispatching network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 00:11:23 user nova-compute[75244]: WARNING nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received unexpected event network-vif-plugged-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 for instance with vm_state deleted and task_state None.
Nov 30 00:11:23 user nova-compute[75244]: DEBUG nova.compute.manager [req-0315505d-cff0-45d8-aaaa-e471695b2286 req-fba8eefd-efb2-420b-bd04-0a2dfd9e7c5f service nova] [instance: 22500ec9-33b8-4636-9909-07f0b815388d] Received event network-vif-deleted-11e58cf5-9b76-4e9f-9e22-2bc76c29ff55 {{(pid=75244) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 00:11:23 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-692ec5e7-f9f4-43d3-a093-c5e8db2931f9 tempest-SnapshotDataIntegrityTests-2116270979 tempest-SnapshotDataIntegrityTests-2116270979-project-member] Lock "22500ec9-33b8-4636-9909-07f0b815388d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.491s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:26 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:11:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:11:26 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 00:11:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:11:31 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:11:31 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:11:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=24.967227935791016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:11:31 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:11:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:43 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:11:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:49 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:11:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:11:53 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:11:53 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:11:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:15 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:27 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:12:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:12:27 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 00:12:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:12:33 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:12:33 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9227MB free_disk=24.965740203857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:12:33 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:12:34 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:50 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:55 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:55 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75244) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 00:12:56 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:12:57 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:02 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:07 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:12 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:17 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:22 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:27 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:29 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Starting heal instance info cache {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 00:13:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Rebuilding the list of instances to heal {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 00:13:29 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Didn't find any instances for network info cache update. {{(pid=75244) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 00:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:32 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75244) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 00:13:35 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:13:35 user nova-compute[75244]: WARNING nova.virt.libvirt.driver [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Hypervisor/Node resource view: name=user free_ram=9259MB free_disk=24.958480834960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75244) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75244) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.compute.provider_tree [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed in ProviderTree for provider: cc9d5100-ee82-415a-9911-9d1a045bcd6b {{(pid=75244) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.scheduler.client.report [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Inventory has not changed for provider cc9d5100-ee82-415a-9911-9d1a045bcd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75244) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG nova.compute.resource_tracker [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Compute_service record updated for user:user {{(pid=75244) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 00:13:35 user nova-compute[75244]: DEBUG oslo_concurrency.lockutils [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 00:13:36 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:37 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:38 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:40 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:42 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:45 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:45 user nova-compute[75244]: DEBUG nova.compute.manager [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75244) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 00:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 00:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75244) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 00:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75244) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 00:13:47 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 00:13:51 user nova-compute[75244]: DEBUG oslo_service.periodic_task [None req-05d85bbc-5bef-4be5-bfc6-5d472288a9c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75244) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 00:13:52 user nova-compute[75244]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75244) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}